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Attention opportunists: Were looking lor some really good software engineers. And if you’ve 
got the credentials, we’ve got the enticements. First and foremost, you’ll be working lor 
the world’s number one in workgroup database software - with sales over $100M last year 
alone. You’ll be working with the industry’s most cutting-edge technology (JDBC, XML, 
Mac OS X, Windows 2000, etc.). You II he eligible lor extremely competitive compensation- 
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Your Name Here 

FileMaker Software Engineer 
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5201 Patrick Henry Drive 
Santa Clara, CA 95054 
Phone: (408) 987-7664 
Fax: (408) 987-3002 

www.filemaker.com 



including stock options in Apple - and matching 401 (k) plan. And 
as part of the team, you'll be encouraged to pipe in your creative two 
cents. Which, in time, just might help you write your own business 
card. Send your resume to dreamjob@filemaker.com or visit us at 
www.filemaker.com for more particulars. What’s your problem?" 


trademarks of FileMaker. Inc. All trademarks are the property of their respective holders. 
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You solve problems. If mistakes slip through the cracks or 
getStuck in your workflow, that's a problem. Not to worry. 
tTrack ,M 4.0 workflow solutions on the Web is here. Take bug 
tracking for instance. tTrack 4.0 lets you keep track of where 
a project has been, what has been done to it and what needs 
to occur to completed successfully. So missing bugs doesn't 
turn into an explosive situation. Visit our Web site for all 
the in-depth technical details we wouldn't dare put here. 




Contact us for a Free Trial: 
www.teamshare.com 
1.888.teamshare 
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New! Together Control Center 4.0 

Model, pattern, edit, gen doc, version, doc, audit/metric, compile, debug, 
provision, assemble, deploy, run—what The Home Depot calls 
^ _ "the backbone of all our softw are development" 
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OneSource™ simultaneous round-trip engineering —class diagrams 
and source code, always-in-sync, always up-to-date, giving you 
complete freedom to work visually or textually (Java, C++, or IDL) 
as you see fit. Plus robust programming editor with syntax high¬ 
lighting and auto-completion features; compiler with messages auto- 
linked to diagram element, source-code line, and property editor; 
and distributed, multi-threaded debugger. 

EJB features : generate, 


. ud 

BiaPlay ™ team support is just a mouse-click away—complete 
end-to-end multi-user version control for models, source, and 
documentation across the enterprise (using CVS or whatever 
SCC-compliant version-control system you prefer). 
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configure, reconfigure, 
customize, and compile. 
Visually edit your create, 
finder, and business 
methods in any EJB; 
Together auto-updates 
the supporting 
interfaces and primary- 
key classes (hidden from 
view, unless you choose 
otherwise). Plus round- 
trip EJB-JDBC, round-trip 


ERD-JDBC, and round- 


trip JSP-JavaBean 



support . Also generate, 


configure, reconfigure, 
and customize GoF 
patterns . Add your own 


company-specific 


patterns too (express 


simple patterns in text, complex patterns in Java). 

(TogetherSoft 

’Having seen Together's direct use of Java code to support the models, I am forced to wonder why 
anyone would like to work in any other way! I do think that the strength of the product lies in Its 
interooerabilitv— it’s a 'complete solution* , not just a modeling tool.*—Jon Collins, 

Senior Analyst. Bloor Research I Batten' 

A C hoice 

TogetherSoft Corporation 
920 Main Campus Drive a 
Raleigh, NC 27606 USA J3\#3 
1-919-833-5550 
www.togethersoft.com 

C2000 TogetherSoft Corporation 
Al rights reserved. Not an features are available in ai editions. 

Together is a registered trademark of TogetherSoft Corporation. OneSource, BigPlay. and Raftmaker are trademarks 
of TogetherSoft Corporation. Java. JavaBean, and EJB aro trademarks of Sun Microsystems, Inc. 



UML 1.3 (nine kinds of diagrams) including reverse engineer¬ 
ing of any source code into sequence diagrams . ERDs too. 
Plus RaftMaker™ customizable multi-level doc (Javadoc 2 
superset plus RTF)—invoke it as part of your daily build, 
deliver always-up-to-date doc to your boss. 

Download “Together Whiteboard"www.togethersoft.com/dd 

’I really like Together...No olher vender has even come close to making such an intuitive 
and convenient diagramming interface .*—David Marine, Sr. Web Applications, NetSolve 
*We discovered in our evaluation that other modeling tools only get used during the front- 
end of a project. Yet we found Together to be the one UML modeler that our developers 
will use from start to finish . Why? It's the only one that delivers simultaneous (rather than 
batch-mode) round-trip engineering*—Curtis Chambers, The Home Depot 
"Thanks for your wonderful product, I just did a download and install of Tqgether Control 
Center 4.0.1 wonder how you guys find time to incorporate so many additional new features 
in the short span of time between version 3.0 and 4.0.1 am. as a power user of your product 
very happy to see your progress. Great and good job. Keep it up.*—Suresh Balamaran. 
TimeO, a Perot Systems Subsidiary 

"Together Enterprise is a team development management tool. It provides simultaneous 
round-trip engineering (for Java. EJBs, C++, and JDBC); multiuser team development; 
multilevel documentation generation; a pattern maker with modeling components; custom¬ 
izable metrics checking and likely-error audits; and a UML 1.3 custom diagram definer. It 
fully supports EJBs, traces requirements, supports large projects, and offers extensive 
customization options and integration with other products. Together supports IDL and DDL, 
and e-business plug-ins. Together Enterprise 3.2 also includes a new Project expert, 
improved ‘finest level of detail* Rose import and export-it no longer requires running Rose 
to import or export-plus additional metrics and audit features, including bar charts and 
and Keviat (’spider web") graphs.’—JavaPro Reader’s Choice Award 
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INSIDE XBOX GRAPHICS 21 

by Michael Abrash 

Microsoft’s upcoming Xbox game console has some pretty impressive graphics capabilities. Michael 
ought to know—he’s been developing the graphics internals for die past few months. 

TRIANGLE INTERSECTION TESTS 32 

by Eric Haines and Tomas Moller 

Our authors provide an alternative to the classic methods of testing whether a point is inside a 
triangle. This new technique is based on baiycentric coordinates. 

OPTIMIZING 3DNOW! REAL-TIME GRAPHICS 40 

by Max I. Fomitchev 

One approach to pumping up real-time 3D graphics performance is AMD’s 3DNow! technology, 
which adds floating-point SIMD extensions to the original x86 instruction set. Max examines 
3DNow! technology, then provides guidelines for optimizing its perfonnance even more. 

AUGURAL IMAGE ZOOMING 48 

by Wm. Douglas Witheis 

Augural image zooming is a new method for zooming images with a minimum of computation, 
while keeping smooth regions smooth and sharp edges sharp. 

AUTOMATED BUILDS 60 


by Aspi Havewala 

Automated builds refer to a series of commands that can be executed to compile and link source 
code into its final deliverable format. Aspi discusses some advantages of automated builds, and 
suggests some features your builds can incorporate. 

EXAMINING VMWARE 70 

by Jason Nieh and Ozgur Can Leonard 

VMware is a virtual machine platform that provides an abstraction of x86 PC hardware so that 
multiple operating systems can run unmodified at the same time on a standard PC. Among other 
things, this means you can run Windows applications with Linux. 

A LINUX IEEE 1394 CONFIGURATION ROM DECODER 80 

by William F. Alexander 

William’s DumpRom program is designed to read and decode the configuration ROM of 1394 
peripherals. He presents the Linux implementation of DumpRom using an OHCI 1394 controller. 



Images courtesy of xMicrosoft Corp- 



Spiritual Robots 

Doug Hofstadter, Ray Kurzweil, Bill Joy 
Java in the Real World 
Moderated by Peter Coffee 
C++ 2K 

Bjarne Stroustrup 

http.V/www.ddj.com/technetcast/ 


EMBEDDED SYSTEMS_ 

RELIABILITY & EMBEDDED NETWORKS 86 

by H. Thomas Richter 

Reliability requirements for embedded networks are more critical than with nonembedded 
networks. Thomas presents a new method for ensuring reliable communication between 
hosts in small networked environments. 

INTERNET PROGRAMMING_ 

DB FORMS: PHP, MYSQL, AND PHPLIB 98 

by Danyl Ross and Con Zymaris 

Darryl and Con use the PHP server-side scripting engine, MySQL database engine, and 
PHPLIB class framework to build DB Forms, a reusable database framework for writing web 
applications. 
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FairCom has been providing fast, flexible and scalable database 
development tools to the commercial developer for over 20 
years. During this time FairCom has been utilized within 
countless embedded appliances, web server development 
projects and many vertical market applications. By offering 
industry leading performance, unsurpassed multi-user data 
availability and a complete transaction enabled database Server, 
FairCom provides the depth and breadth of technology to bridge 
all of your database development needs. Add FairCom to your 
toolbox today. 


ONE FAST ISAM TOOL, 
MANY PLATFORMS 

Every copy of c-tree Plus supports all these platforms: 
Windows 95/98/2000/NT, Novell Netware, Mac OS, 
OS/2, Solaris (SPARC), Solaris (Intel), Sun OS, AIX, 
HP UX, Linux (Intel, Alpha), SCO, Interactive, AT&T 
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ANSWER 


D. Use Rogue Wave Software's Cross Platform Components 

Rogue Wave's Cross-Platform suite of C++ components is the missing element 
that links your core business applications to high-powered e-business systems. 

Our family of cross-platform components makes it easy for you to connect and 
integrate multiple, large scale, and distributed applications across operating 
systems, legacy platforms and architectures. 

No matter what you need - business analysis, database access, performance 
enhancements, and more - our extensive suite of pre-built C++ components 
provide the links that helps you turn your bricks-and-mortar infrastructure into 
a powerful dicks-and-mortar e-business system faster and easier than you 
ever thought possible. 

So go ahead and raise your developer IQ a few points. Check out Rogue Wave 
Software's Cross-Platform components today. 

See us on the web at: www.roguewave.com/specials/iqtest2 



Rogue Wave 

SOFTWARE 

E-COMMERCE ESSENTIALS 


5500 Flatiron Parkway 
Boulder, CO 80301 
TEL 303.473.9118 
FAX 303.447.2568 

www.roguewave.com 



EDITORIAL 


Embrace, 
Extend, 
Extinguish: 
Three Strikes 
And You’re Out 


A t just about any gathering of Microsoft employees, Mensa cards are as common as canapes and 
Ph.D. sheepskins are as numerous as napkins. Which makes you wonder how a company so 
replete with smart people can do so many dumb things. 

For instance, whose bright idea was it to try to turn the open Kerberos security standard into a 
proprietary specification, then unleash lawyers on anyone who discussed it? The story goes like this: 
When implementing security for Windows 2000, Microsoft settled on the Kerberos user authentication 
and session key distribution system. Based on work done more than 20 years ago, Kerberos is well 
known, understood, and generally considered a solid system. In the spirit of its strategy to “embrace, 
extend, and extinguish” open standards, however, Microsoft extended Kerberos with undocumented 
proprietary features in an effort to prevent interoperability— one of Kerberos’s strong suites. 
Specifically, the Windows 2000 Kerberos implementation makes use of an undefined field to store 
authorization data. This field was intentionally left undefined by Kerberos’s authors so that vendors 
(like Microsoft) could implement customized versions. The upshot in this case is that, although 
Microsoft claims otherwise, nonMicrosoft servers can’t access the security features of Windows 2000, 
making it difficult (if not impossible) for nonMicrosoft versions of Kerberos to work on networks that 
have Windows 2000 desktops and nonMicrosoft servers. Strike one. 

Microsoft tried to weasel out by splitting syntactical hairs, particularly in its definition of 
“interoperable.” According to Microsoft, Kerberos interoperability addresses only the authentication 
process, which is clearly defined in the open specification. Microsoft went on to contend that 
interoperability does not involve authorization, which is where the data field comes into play. 
Microsoft is open about this: If you want access rights to Windows 2000 applications, the operating 
system has to process its own authorization. 

Kerberos proponents had scarcely yelled “foul” before government antitrust lawyers were all over 
Microsoft like a cheap suit. However, the day before a government court brief was filed, Microsoft 
blinked—well, sort of. What the company did was call into play the old trade-secrets/intellectual- 
property gambit and required everyone reading the spec to sign a nondisclosure agreement that 
barred reproduction or redistribution of the information. But according to Clifford Neuman, senior 
researcher at the University of Southern California, principal author of the original MIT version of 
Kerberos, and editor of the Internet Engineering Task Force’s Kerberos standard document, 
Microsoft’s trade-secret claim is balderdash, since he first described the scheme in 1993 (see 
ftp://ftp.isi.edu/in-notes/rfcl510.txt). Considering the status of antitrust procedures at the time, you 
have to wonder who came up with the NDA tactic, since it again opened the door for critics charging 
that Microsoft leverages monopoly powers to force people to use its servers. Strike two. 

As if all this wasn’t odious enough, when derogatory comments about Microsoft’s approach to 
Kerberos cropped up on Slashdot (http://www.slashdot.org/), the best idea the Microsoft brain trust 
could come up with was censorship. Using the Digital Millennium Copyright Act (a smelly piece of 
law bought and paid for by the entertainment industry), Microsoft tried to coerce Slashdot into 
removing reader posts on its web site, citing “unauthorized reproductions of Microsoft’s copyrighted 
work.” Strike three. 

To its credit, Slashdot stood up to Microsoft and refused to take down the posts. Believing the best 
defense is a good offense, Slashdot lawyers fired back a series of questions of their own to Microsoft 
lawyers, questioning the basis of the company’s claims and charges. At this writing, Slashdot hasn’t 
heard back from Microsoft’s lawyers. A Microsoft spokesperson has told us that Slashdot chose not to 
address the points that Microsoft raised and that Microsoft will not speculate on any further action at 
this time. 

Let’s be clear on one thing: Microsoft’s customization of the authorization placeholder field is 
entirely legitimate. Others, including the OSF with its DCE specification, have customized Kerberos in 
a similar manner. What’s at issue here isn’t Microsoft’s Kerberos extensions, but the company’s 
disingenuous ownership claims, onerous licensing policies, and bullying tactics. In an effort to clean 
up the sour milk Microsoft has spilt, Clifford Neuman is drafting a proposal to include in the 
specification a list of identifiers across different systems—including Windows 2000—in a generic 
manner, along the lines he described in 1993. 

Microsoft doesn’t have a monopoly on dumb ideas; witness the adoption of the Uniform 
Computer Information Transactions Act (UCITA), Digital Millennium Copyright Act, and the like. 
Unfortunately, large organizations often foster stupidity because responsible individuals can hide 
behind the anonymity of faceless committees and hired public-relation flacks. And in these kinds of 
environments, it is just as sad that good ideas often go unacknowledged and unrewarded. 



editor-in-chief 

jerickson@ddj.com 
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in minutes, 
not months. 



Objective Studio makes it easy to 
create a Microsoft Outlook-styie 
interface in minutes. 
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Don’t waste hundreds of hours building user interfaces 
for your Windows applications. Get Stingray’s Objective 
Studio and you can build a sharp, sophisticated 
Microsoft-style GUI in as little as 15 minutes! 

Objective Studio’s AppWizards plug directly into 
Microsoft Visual Studio 6.0 and make designing really 
sharp front ends as easy as a few points and clicks. 

When you don’t have development time to waste, use 
Objective Studio from Stingray. 

See for yourself how quick and easy great GUIs can 
be. Take a guided tour of the Objective Studio at 

www.stingray.com/win2000. 
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LETTERS 



Nanoseconds Not Fast Enough? 

Dear DDJ , 

I just received my June 2000 issue of DDJ 
and found, on the “News & Views” page, 
your report “Nanoseconds Not Fast Enough? 
Here Come Femtoseconds.” You stated in¬ 
correctly that “Researchers at Lawrence 
Berkeley Laboratory have produced for the 
First time light pulses lasting less than 300 
millionths of a billionths of a second—300 
femtoseconds, in other words.” And, at the 
end, “What’s important about this break¬ 
through is that it will let scientists capture 
the motion of atoms during physical, chem¬ 
ical, and biological reactions on an in¬ 
finitesimally small time scale.” 

Actually, this is already old news. Ahmed 
Zewail of Caltech just received the Nobel 
Prize in Chemistry for his work over the 
last decade and a half using femtosecond 
pulses to study molecular motion and re¬ 
action dynamics. (He coined the term “fem- 
tochemistry” to publicize this research.) I 
coauthored a paper 13 years ago ( Science 
v240, 1988) in which we used 60-femto¬ 
second light pulses to directly observe the 
initial dynamics of energy capture in a 
photosynthetic bacterium. The picosec¬ 
ond barrier (10' 12 sec.) for light pulses was 
broken even many years before that. 

I read the Lawrence Berkeley Lab press 
release and it’s easy to see how you might 
have been mislead by it. I think what’s spe¬ 
cial about their work is that they got their 
femtosecond light pulses from a syn¬ 
chrotron source, rather than from an ordi¬ 
nary laser. It’s certainly not that they got 
300 femtosecond light pulses—you can 
buy commercial laser systems that do bet¬ 
ter than that. Probably, the LBL press of¬ 
fice didn’t clearly understand what they 
were announcing. Bob Schoenlein, the 
head of the team at LBL who did this work, 
was in the group at Bell Labs that created 
die 60 fs optical pulses used in the research 
I cited, so I know the misrepresentation 
couldn’t have come from him. Anyway, 
thanks for another good issue of DDJ. 

W. Thomas Pollard 

pollard@schrodinger.com 
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Why Not Smalltalk? 

Dear DDJ , 

The June 2000 issue of DDJ continues its 
tradition of excellence in technical re¬ 
porting. Clearly, object-oriented design 
continues to be a crucial part of modem 
software development. However, you can 
hardly think about OO properly without 
bringing die normadve models of Smalltalk 
and Eiffel into the picture. Yes, I know 
DDJ is devoted to practical development 
of software and your focus is upon Java, 
C/C++, XML, and Perl. And, yes, I under¬ 
stand that the community of Eiffel and 
Smalltalk users, even combined, is dwarfed 
by the red tide of C++ practitioners. But 
Smalltalk and Eiffel received no cover¬ 
age— not even an inset or sidebar. Bertrand 
Meyer, the audior of Object-Oriented Soft¬ 
ware Construction , mentioned by Perez 
and Boado on page 24, designed Eiffel to 
fulfill his design principles. It is very im¬ 
portant for DDJ readers to know that both 
these languages have creative, healthy, 
and thriving communities of users who 
need and do make the payroll at week’s 
end. I’m part of the Smalltalk communi¬ 
ty, so I’ll focus on it. 

The news about Smalltalk is wonderful 
and inspiring. We have an industry coun¬ 
cil, great jobs at good salaries, a compre¬ 
hensive links site and great news clear¬ 
inghouse, and litanies of business users. 
Smalltalk is on the Web as applets, as a 
web ring, and as several Wiki servers de¬ 
voted entirely to Smalltalk. One is written 
in Smalltalk itself. There is an important, 
international, and hugely cross-platform 
dialect called “Squeak” being developed 
that has a liberal license. There is a GNU 
Smalltalk that is intended as a superior 
scripting language. Smalltalk is fun, too. 
It is sad that most software developers 
aren’t aware of these resources. 

It is also sad because even developers 
who must, by nature of their projects, use 
Java or C++ are deprived of the insights 
and creativity that are part of the Smalltalk 
development community. It is a refresh¬ 
ing and thrilling experience to learn class 
libraries which have been honed by 20 
years of diligent and expert use. In my 
business, Smalltalk is heavily integrated 
with relational databases, typically non¬ 
object ones, and I find it comparatively 
easy to develop classes that respond to 
abnormalities and error conditions, such 
as exceeding resources or dirty data. Kent 
Beck’s Smalltalk Best Practice Patterns 
(ISBN 0-13-476904-X) is the best of the 
software patterns books. His “extreme pro¬ 
gramming” methodology works best with 
Smalltalk, although it can be adapted else¬ 
where. Please consider Smalltalk and Eif¬ 
fel in future issues. 

Jan Theodore Galkowski 

Dr. Dobb’sJournal, August 2000 


Shared Responsibility 
for Virus Attacks 

Dear DDJ , 

For software and e-mail, as with auto¬ 
mobiles, we need to have a better con¬ 
sensus of understanding for the division 
of responsibility between the maker and 
user. We should not give our secretary or 
any user, tools that can hang up the whole 
company e-mail system, with one wrong 
keystroke. A similar thing goes for our 
home systems. (At least the command to 
reformat our hard drives is nowadays suit¬ 
ably hidden.) Manufacturers should not 
even make and sell such systems. 

Likewise users should not use systems 
that are open to malicious or accidental 
damage by outsiders. Companies should 
NOT make part of their standard operat¬ 
ing procedures the execution of unau¬ 
thenticated programs received as macros 
in data (DOC and XLS files) or via e-mail, 
unless such programs are limited in what 
that can do by the local computer. 

In particular, Internet browsers and e- 
mail applications should never allow the 
running of unauthenticated programs re¬ 
ceived from the outside that can have ac¬ 
cess to the whole computer system. At the 
most, such unauthenticated programs 
should be limited to controlling the dis¬ 
play and to writing and reading their own 
cookies. Microsoft Outlook Express (OE5) 
is particularly bad in this respect. By de¬ 
fault, its options to run programs received 
by e-mail were turned ON (so that they 
could run the Melissa, KAK, and the 
I LOVE YOU programs). 

Microsoft’s Word and Excel products are 
also bad in that they, by default (in 
MS097), can execute programs contained 
in macros in DOC and XLS data files that 
can wipe out your disk and e-mail the same 
destaictors automatically to your friends. 

The Java model for applets was sup¬ 
posed to offer a solution for this security 
problem built around authentication with 
public cryptosystem keys and trusted 
sources. And lately, I have l^een hearing of 
“sandbox” environments for unsafe pro¬ 
gram execution. Why aren’t we using them? 

The shared maker-user responsibility 
should bear most heavily on the expert 
and program maker. Innocent users should 
be able to buy, install, and use computer 
programs without compromising their sys¬ 
tem and to know with confidence that 
their computer is safe. 

John Herbster 

herb- sci@swbell. net 

Mingw32 
Dear DDJ 

I was surprised by the mingw32 behavior 
A1 Stevens described in his May 2000 “C 
Programming” column—slow execution 

http://www.ddj.com 




Client-Server Vs. Web 
Development 


by Adam Kolawa 

Due to the enthusiastic response of our readers, we 
have decided to continue our series of columns 
about software development by taking a look at 
some of the current trends in the industry. The Web 
has changed software development forever, and it 
doesn't take a prophet to know that this trend will 
continue. As more and more sophisticated 
applications move online, the Web is no longer just 
a place for simple, static Web sites. As such, it’s 
time for software developers to take a serious look 
at the issues surrounding Web development. 

The software industry has always been fond of 
pitting one development technique against 
another. Nowadays, one of the hottest debates is 
between supporters of client-server development 
and Web development. Web proponents 
sometimes claim client-server is dead; client- 
server users see glaring weaknesses in the Web 
paradigm. To make a decision on which to use. it 
is important to understand the critical differences 
between the two approaches. 

When the industry first began to look at dynamic 
Web development, they saw the HTML output 
pages and assumed Web development was limited 
to providing changing text to viewers. Before long, 
however, developers realized the full potential of 
the technology; they could write applications that 
interacted with databases at the back end. and use 
a Web browser as a standard GUI at the front end. 
The problem of teaching people to use a GUI 
would disappear because any computer owner- 
and, therefore, any potential software purchaser— 
knows how to use a Web browser. 

It appeared at this point that client-server was In 
trouble. After all. every client-server application has 
a learning curve, and often a very steep one. 
because people must learn to use a proprietary 
client before they can put the application to full use. 
When companies realized they could deliver 
applications with a standard GUI that everyone 
already knew how to use, they flocked to the Web. 
Web-based applications offer additional benefits, 
they give developers the ability to update software in 
one place—the server—rather than mailing out 
updates, they streamline maintenance, and they 
increase the portability of applications. But in our 
next column, we'll explain why Web development 
isn't a "silver bullet" solution, and why client-server 
still has a valuable place in software development 


Adam Kolawa, Ph.D., Is Chairman and CEO of 
ParaSoft. You can reach him at ak@parasoft.com 
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Click once for 

automatic C/C++ unit testing! 


TM 

C++Test is a new tool from ParaSoft that 
automates C and C++ unit testing, making it easier 
to find and fix errors before they mushroom into 
more serious problems. Testing with C++Test is 
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C++Test automatically performs white-box, black-box, 
and regression testing for C and C++ developers. 


displaying the outcomes, which you can verify with 
one click of the mouse. You can also enter your own 
black-box test cases to be executed by C++Test. 

Regression testing verifies that your modifications 
corrected problems and did not introduce new 
problems into your code. C++Test performs 
regression testing by executing the test cases that 
were run the previous times the class was tested 
and checking to see if any outcomes have changed. 
If outcomes have changed or if C++Test finds 
exceptions, it will report errors. You can replay the 
test cases each time you modify your code. 

Of course, unit testing is just one stage of the error 
prevention process for C and C++ developers. 
C++Test works with ParaSoft's CodeWizard* to 
enforce coding standards automatically each time 
you build a file. C++Test also works with ParaSoft's 
lnsure++* to give you automatic runtime error 
detection each time you test a class or method. Ask 
about ParaSoft's specialized Developers Kits for 
your development team. 



Black-box testing verifies that each class 
behaves according to specifications. C++Test 
performs black-box testing by automatically 
generating and executing test cases and 
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Download your 
FREE DEMO at: 

www.parasoft.com/story aug.htm 


automatic, but it leaves you in control. For the 
quickest testing, you can click once to have C++Test 
open, build, and perform white-box testing on your 
files one after another. For more complete testing, 
you can modify test parameters and let C++Test 
perform automatic white-box, black-box, and 
regression testing. 


If you would like the satisfying 
experience of testing automatically at the unit level, 
please take a moment to download a fully- 
functional demo copy of C++Test today at 
www.parasoft.com/story_aug.htm, or call us at 
(888)305-0041 for more information. 


White-box testing tests the construction of your code. 
C++Test performs white-box testing by automatically 
generating and executing test cases to see how files, 
classes, or methods behave when they are passed 
unexpected inputs. You can control what types of test 
cases C++Test generates by specifying what kinds of 
arguments to use, how many test cases to run, and 
how deeply to search your embedded classes 
C++Test will also build stub functions to test 
methods that call other functions. 


ParaSoft is a registered trademark Jtest. CodeWUard, and Insura** are registered trademarks of ParaSoft and WibWng Is a trademark of ParaSoft. 



















































































(continued from page 10) 
and the ridiculously fat executable that he 
saw when compiling a simple “Hello, 
world.” I’ve used gcc for years, and I can 
hardly believe he’s describing the com¬ 
piler I know and treasure. 

Running the same “Hello, world” through 
g++ 2.7.2, I get a 2-second compile time 
and a 5-KB executable on my slowest Lin¬ 
ux box— quite a difference from the 7- to 
20-second-long compiles and the 166-KB 
to 1-MB executable sizes he’s seeing with 
mingw32. And my CPU is less than half 
the speed of Al’s (it’s a Cyrix PR-133+). 

I doubt that the difference reflects the 
relative merits of open source and propri¬ 
etary software, as Al intimated—though 
I note with irony that I get a smaller exe¬ 
cutable than Visual C++ produces, and I 
get it twice as fast on a machine mnning 
at half the speed of Als. Maybe the be¬ 
havior he’s seeing is unique to the partic¬ 
ular gcc port he is using? It’s certainly not 
typical. 

Scott Maxwell 

maxwell@ScottMaxwell.org 

Al responds: Thanks for your note Scott. 
I was not describing the compiler you 
“know and treasure.” I was describing a 
much newer version with a completely 
different Standard Library. 


The compile execution time and bina¬ 
ry sizes are significant only when you 
compile with the experimental Standard 
C++ Library, which uses all the new Stan¬ 
dard C++ template features, and when you 
tell the compiler to respect the std name- 
space. You cannot do that with 2.7.2 be¬ 
cause 2.7.2 does not support the language 
features the new library requires. I re¬ 
ceived several letters just like yours which 
report respectable times and sizes on both 
“hello world” programs compiled with 
GNU/Linux. In every case the program¬ 
mer compiled both programs with the 
legacy headers and linked with the lega¬ 
cy library. 

As it turns out, comparing binary sizes 
between Win32 ports and GNU/Linux 
ports is comparing apples and asparagus. 
There are other factors having to do with 
dlls, which must be taken into consider¬ 
ation. Comparing 2.7.2 with 2.95.2 is also 
misleading because the compilers and 
legacy libraries are quite different as gcc 
approaches the standard definition. For 
the same reason you cannot compare 2.7.2 
and recent versions of Visual C++. 

Dear DDJ, 

I.was reassured to read that Al Stevens (“C 
Programming,” DDJ , May 2000) has his 
doubts about the extra overhead incurred 


by the new Standard C++ Library. I, too, 
recompiled programs using # include 
<iostream> instead of # include <iostream 
.h> and noticed that they took 50 percent 
longer and were nearly 100 percent larg¬ 
er. And this was with the fast Microsoft Vi¬ 
sual C++ 6.0 compiler. The GNU compil¬ 
er is much worse! From a software 
engineering perspective, it is valid to ask 
the question whether being absolutely up- 
to-date is worth the extra trouble. 

The root of the trouble is the rampant 
overtemplatization in the implementation 
of the standard iostream, string and other 
classes involving char traits. Sure, they 
work for both ANSI and Unicode, but how 
many programs use both? I see that they 
make life easier for the library developers, 
but at the price of making life more diffi¬ 
cult for application developers, who are 
generally not STL rocket scientists. Again, 
this is a software engineering no-no. 

A full version of this rant can be found 
in my article for EXE magazine (http:// 
www.exe.co.uk/soapflakes/soappull.asp? 
page= 000101.html). 

Steve Donovan 

sjdonova@csir.co.za 


DDJ 


Not scaling on multi-CPU boxes? 



The problem: Compiler runtime libraries allow only one thread at a time to be active in the heap. So on SMP systems, when 
multiple threads make concurrent heap requests, all but one will be blocked by the heap manager, nullifying the benefit of the 
extra CPUs. Worse yet, each time a thread is blocked, the OS invokes a context switch. The result: adding processors results in 
a vicious cycle of context switching that can prevent your app from scaling. 

The solution: SmartHeap™ for SMP. For NT, Solaris, HP-UX, AIX, DEC OSF, SGI IRIX. Partial user list: Netscape, HP, 
Lexis-Nexis, Lucent, NASDAQ, Computer Associates, Ericsson, Spyglass, Allaire, NetGravity, Software.com, Simware, RightPoint, 
OptiMark, Fidelity, Bankers Trust, Pinnacle, UPS, OnDisplay, i2 Technologies, New Era of Networks, Rockwell, eDocs. 


www.microquill.com/smp 
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Each year, the illegal use of software 
consumes nearly 50% of your potential 
revenue. With the flames of piracy burn¬ 
ing away your profits, can you afford not 
to protect your software? 


Losses ($M) due to piracy (per region) 



HASP is widely acclaimed as the world’s 
most advanced software protection 
solution. Since 1985, thousands of 
developers have used millions of HASPs 
to protect billions of dollars worth of 
software. 

Why? Because 
HASP’S security, 
reliability and 
ease-of-use led 
them to a simple 
conclusion: HASP is the 
most effective software protec¬ 
tion system available. 

To learn why more developers chose 
HASP than any other software protection 
system, visit our website at 

www.eAladdin.com/dobbs, or call 
our security specialists at: 

1-800-562-2543 
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www.eAladdin.com 


ALADDIN 


Securing the Global Village 


United States: France: Germany: Japan: Netherlands: United Kingdom: International: 

P: (847) 808.0300 P: (33) 1 41.37.70.30 P:+49.89.894221.0 P:+81.42.660.7191 P:+31 .(0).30.688.0800 P:+44.(0).1753.622266 P:+972.(0)3.636.2222 

F: (847) 808.0313 F: (33) 1 41.37.70.39 F:+49.89.894221.40 F:+81.42.660.7194 F: +31 .(0).30.688.0700 F: +44.(0).1753.622262 F:+972.(0)3.537.5796 

hasp.sales@us.aks.com info@aladdin.fr info@aladdin.de sales@aladdin.co.jp info.hasp@ealaddin.com sales@aldn.co.uk hasp.sales@ealaddin.com 
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Island Insider ™ 
Weekly E-mail Newsletter 

Weekly Special Offers & Announcements 

C++ Enterprise ! Java Linux ! Visual Basic I 




100+ pages of products 
and information 
for Developers! 

Get a FREE Subscription 
to our catalog by calling 

800-445-7899 
or subscribe at 
1 programmersparadise.com, 
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LEADT00LS Imaging 

by LEAD Technologies, Inc. 

LEAD’S award-winning imaging 
technology is chosen by Microsoft, 
Hewlett Packard, Intel, Boeing, Xerox, 
and thousands of other companies for 
use in their high-volume applications 
and internal systems. LEADTOOLS gives 
developers the most flexible and powerful 
imaging technology available offering 
imaging technology in 19 categories 
including: import/export: compression; 
image processing; color conversion; 
display/special effects; Internet/intranet; 
annotations; medical imaging; OCR; 
barcode recognition; and much more! 

TestTrack for Windows 

by Seapine Software 
TestTrack is the fastest and most 
complete multi-user bug tracking 
solution for Windows 95/NT. 

Tracks bug and feature requests, 
customers, users, test configurations, and 
more. Advanced features include e-mail 
notifications, e-mail bug import, duplicate 
bug handling, release note generation, and 
much more. Distribute TestTrack’s stand¬ 
alone bug reporter to your customers to 
automate customer support. With all of its 
power, TestTrack remains the easiest bug 
tracking solution to use and maintain. 

* Windows dedicated license. 
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Snaglt 5.0 

By TechSmith Corporation 
Easily capture, edit, annotate, print, and 
save anything from the Windows desktop. 
TechSmith’s award-winning Snaglt even 
captures scrolling windows, cascading 
menus, cursors, AVI video, and true text! 
New v5.0 adds Studio, a powerful object- 
based annotation editor, especially 
designed with the documentation author 
in mind. Snaglt is the most complete 
solution available for any screen 
capture need. 


NT Service Toolkit™ 

by Desaware, Inc. 

With the NT Service Toolkit '' you can 
create services in minutes-with 
almost every feature available to C++ 
services. And you can use all the VB 
IDE tools to debug your service while 
it runs. This new product supports all 
NT service options and controls and 
adheres to all VB threading rules. 
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FarPoint’s Spread 3 

by FarPoint Technologies 
Use FarPoint’s Spread 3 to create powerful 
database front-ends, manage the display 
and entry of two billion items using the 
enhanced Virtual Mode, print reports using 
Print Preview, perform calculations, 
import/export Excel 97 files (32-bit versions), 
export HTML files (32-bit versions), sort 
data, support OLE Drag and Drop, or take 
advantage of its unparalleled cell-level 
formatting, including twelve built-in cell 
types. Unmatched power, flexibility, and 
speed combine to make Spread the perfect 
component for any application. 


FarPoint’s Spread 3 
Paradise No.F02 0120-BP 
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dtSearch® 

Instantly search gigabytes of text! 

Over two dozen text search options. 
Supports popular file types. Displays high¬ 
lighted "hits" & images. Also available: 
dtSearch LAN; dtSearch Web (“point & 
click" set-up; on-the-fly conversion to 
HTML from other popular file types; high¬ 
lights "hits" in browser; keeps HTML links 
& images; PDF support); dtSearch Text 
Retrieval Engine (sample code in multiple 
languages). 

“Very powerful... a staggering 
number of ways to search" 

—Windows Magazine 
"Tremendously powerful" 

—Visual Developer 
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ProEssentials 

by Gigasoft 

A recent runner up in the 2000 Delphi 
Informant’s Readers Choice Awards, 
ProEssentials is gaining recognition as a 
very powerful and easy to use charting 
tool. With interfaces, example code and 
documentation for Visual Basic, Access, 
Visual C++, Delphi, and Builder, 
ProEssentials can be easily implemented 
to give your projects that extra professional 
appeal. If you haven’t seen a demo of 
ProEssentials, we encourage you to down¬ 
load the fully functional evaluation edition 
(5M) on programmersparadise.com. You 
will definitely find ProEssentials interesting. 
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SPF/SourceEdit v.3.0 

by Command Technology 
SPF/SE provides ISPF-style 
file management and editing 
for Win 95/98/NT/2000 

Features include: three interface styles 
(Windows, Modern or Legacy SPF); 
ISPF/PDF commands; legacy style dialog 
stacking; enhanced file lists; customizable 
source colorization; modifiable edify 
popup menu; ASCII/EBCDIC; Variable 
or Fixed records; 2-line HEX; “C" 

macro language. ._ 

Download a 
demo today. (£ 
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FaxMan® Jr. 

by Data Techniques 

Lightweight ActiveX Controls for 

Fax Enabling Apps in Minutes 

The FaxMan Jr. toolkit features: 

• Lightweight 32-bit ActiveX Control support 
for sending and receiving faxes 

• Printer drivers for creating fax output 
from any Windows application that 
supports printing 

• Automatically works with most Class 
1/2/2.0 faxmodems 

• Auto Configuration for fast, easy, 
affordable installation and use. 


To order—programmersparadise.com or call 800-445-7899 
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EAServer Small 
Business Ed. 3.5 

by Sybase 

Sybase Enterprise Application Server 
(EAServer) is the highly scalable, 
robust deployment foundation for Web 
and distributed applications. EAServer 
offers cross-client and cross-component 
support for almost any type of distributed 
application—those based on CORBA, 
JavaBeans, Enterprise JavaBeans, 
PowerBuilder, and COM components, 
as well as existing C/C++ applications. 


RoboHELP Office 

by eHelp Corporation, formerly Blue Sky Software 
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Recognized by everybody as 
the industry standard in Help 
development. Point and click 
your way to full-featured 
Help systems in record time! 

• Generate all Help formats from the 
same source project: MS HTML 
Help, WinHelp, JavaHelp, cross¬ 
platform WebHelp & Printed Doc 

• Create Help for Web sites, 
intranets and extranets. 

* Offer applies only to RoboHELP 

2000 purchases. 


GUARANTEED BEST PRICES* | 

Should you see one of these products listed at 
a lower price in another ad in this magazine. 
CALL US! We’ll match the price, and still offer 
our same quality service and support! 

*Terms of the offer: 

• Offer good through August 31.2000 

• Applicable to pricing on current 
versions of software listed 

• August issue prices only 

• Offer does not apply towards 
obvious errors in competitors' ads 

• Subject to same terms and conditions 
Prices subject to change. 

Not responsible for typographical errors. 
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PowerTCP Tools 

By Dart Communications 
Need to add Internet 
Communications to your project? 
With numerous sample projects, 
it is now easier than ever to 
add Internet Connectivity to any 
application. Just choose from our 
list of ten focused products: 


PowerTCP Tools 
Starting at 

9 189." 


PowerTCP Webserver 
PowerTCP Emulation 
PowerTCP Telnet 
PowerTCP Winsock 
PowerTCP Server 


PowerTCP Mail 
PowerTCP Web 
PowerTCP SNMP 
PowerTCP FTP 
PowerTCP Secure 
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Videosoft VSVIEW 7.0 

by VideoSoft 

View, Format, Export, and Print Documents as 
you never could before! Give your Visual Basic 
applications uniquely powerful capabilities to 
create documents and reports, and then, pre¬ 
view, export, and print them. Dependency free! 

• New output options provide export of 
documents to RTF and HTML formats 
preserves all font and paragraph 
formatting as well as tables. 

• View, Load, and Print your VSVIEW 
documents over the Web. 

• Improved Document Navigation with 
an optional navigation bar. 

And Much More... 


ProblemTrackor 
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ProblemTracker 

by NetResults" 

A powerful, easy-to-use Web- 
based defect tracking and change 
management system. 

• Familiar Web Interface (100% Web-based) 

• Cross Platform Support 

• Customizable Per-User Home Page 

• Email Notification 

• Integrated Access Control 

• Configurable Workflow 

• File Attachment 

• Customizable bug record, display, 
email contents, reports, etc. 

• External User Support 

(strategic partners, customers, etc.). 


Intel® Software Performance Tools 

by Intel 

Build Faster Applications, with 
Help Straight from The Experts 
Who Know Processors Best. 

• VTune'” Performance Analyzer non- 
intrusive sampling and call graph 
profiling offer multiple ways to 
understand code performance. 

• Intel® C/C++ Compiler* designed from 
the ground up to take full advantage of 
Intel’s latest processors. 

• Intel® Fortran Compiler* delivers outstanding 
application performance with advanced 
features like Profile-Guided Optimization. 



* Call for pricing 
on compilers. 


VTune Performance 
Analyzer 
Paradise No. 

123 0142-BP 

s 421.“ 


Apollo Database Server 5.1 

by Vista Software 

Affordable, High-Performance Database Technology 

Apollo is an award-winning portable database engine available in 
VCL, OLE DB and ASP editions. In addition to building standalone 
and peer-to-peer database applications, each Apollo application 
can connect to the Apollo Database Server using the same 
code set for true client/server computing. SQL-92 support, 
Transaction Processing, Stored Procedures and much more! 



Paradise No. 
V49 0112-BP 

s 624." 
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s 149. 95 


Stamina" 

by MicroDexterity, Inc. 

400 Fast Functions for VB & VBA 

Stamina (formerly Muscle32 “) has nearly 
400 routines for file indexing, text 
searching, array and file sorting, disk 
and directory scans, CRCs and 
checksums, splitting and merging files, 
fiddling bits and bit arrays, shifting 
and rotating numbers, specialized 
string and date formatting, simple 
encryption, and lots more—all with 
a code footprint of about 70K! 

Stamina is written in fast 32-bit MASM, 
and works with all 32-bit versions of 
VB and VBA. It comes with a 30-day 
satisfaction guarantee and is royalty-free. 



WebProject 

by VisualSoft Technologies, Ltd. 
asam 


A next generation 
Project Management 
system. Integrating a 
set of eight powerful 
modules, provides the 
online status of your 
projects from anywhere 
on the globe. Its features address every aspect 
of modern PM: Reduced TOO (Total Cost of 
Ownership): Improved project throughput: Enhanced 
PM skills: Centralized and secure system 
administration; Easy import/export of data from/to 
other project management tools; Instant project 
status for managers, clients and their partners; 
Easy integration with the existing Intranet/Extranet 
setup; Online chat, mail, library and archive facilities; 
Simultaneous access to project information for all 
team members; A central location of all published 
information about the project; Instant access to 
all project information 


Paradise No. 

V50 0210-BP 

S 1,499. 95 


through an intelligent 
search engine; Detailed 
reports about all projects; 
and much more. 



JBPro 

by VisualSoft Technologies, Ltd. 

Provides Java 
developers with a 
suite of smart and 
highly customizable 
Java Beans to 
power-pack their 
applications. Whether an interface development 
or a GUI enhancement, these components enable 
you to increase the efficiency of your applications 
with ease. From the simple color picker for your 
GUI solutions, to the complex scheduling and 
charting components, these handy 100% pure 
Java components are compatible with leading 
IDEs like: VisualCafe; VisualAge Java; JBuilder, 
etc. Includes: JBCalendar; JBChart; JBColorpicker; 
JBGrid; JBList; JBProjectGantt; JBScheduler; 
JBSpin; JBTab; and JBTree. 

Paradise No. 

V50 04B0-BP 

95 


$ 959. 
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To order—programmersparadise.com or call 800-445-7899 


























































The Leader (n Visual Basic Components 
I The Leader In Web Components 


Data Explorer 

Total Ul solution 


• Innovative explorer technology that sits at the heart of 
your application user interface. 

•S^iew Built-in tabs for both Outlook Bar and Data Explorer. 

• Get the look and feel of Microsoft Outlook into your 
application with one integrated, highly functional 
component. 

• Display Visual Basic forms, ActiveX controls, HTML pages, 
ListViews or Office documents in the right-hand pane. 


DataTable 

The next generation of OLE DB data components 


• Grid component with full support for unbound, flat bound 
and hierarchically bound data. 

• Rapid sorting, flexible printing and searching capabilities. 

• ProtoView editing components include Currency, Date Edit 
drop-down calendar, Mask Edit, Numeric and Time. 

• Pluggable integration with ProtoView editing components for 
data validation. 



• Includes drop-in replacement ListBox and ComboBox 
components. 

• Full IE support and exporting to HTML/XML. 
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Data Explorer 
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DataTable 

Calendar 

ComboBox 

Currency 
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(OLE DB/ADO) 
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ListBox 
MaskEdit 
Numeric Edit 
Time Edit 
ScheduleX 

Calendar 
Date Eoit 
DayView 
TaskPad 
Time Edit 
lLe.ey|ewX 

TreeViewX 

ACS 

All Above, Plus: 
Button 
Color Combo 
Font Selection 
Image Combo 
Line-3D 
Marquee 

Multi-Directional 

Button 

Picture 
Percent Bar 
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Highly configurable Outlook-style components that 


allow for the complete customization of all aspects 
of scheduling. 

• The Calendar, DayView and Taskpad components are tightly 
integrated to work together. 

• New Multi-line text and images for calendar dates. 

also from ProtoView 


New Multiple selection drag & drop. 
Visually bind to OLE DB/ADO recordsets. 


Use this familiar, VB-style property management control 
to display and edit application settings and values. 
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Product 1 

| Version 1 

Media ! 

Price 

{Adobe 

Photoshop 

5.5 (^Download 

$609.00 

1 Macromedia 

Drumbeat 

! 2000 

; Download 

$499.00 

| ProtoView 

ActiveX Component Suite 

8-0 & 

> CD-ROM 

$695.00 


Property Browser 
ScreenPrinter 


• Supports multiple selection, check boxes and 
radio buttons. 


• The Color Combo and Image Combo allow quick and 
easy drop-down selection. 


Shape-3D 
Text-3 D 
Volume Dial 


Flexible node editing and tool tips. 
Fast searching and sorting. 


• Create custom property types for browsing. 




































































































































Go with ProtoUiew! 




Best Components Your Applications! 


The Widest Selection 


From dot-com’s to Wall Street, 
ProtoView components are powering 
today’s leading business interfaces. 
From our lightning fast DataTable grid 
and intuitive Data Explorer to the 
polished ScheduleX components, 
ProtoView has the best and widest 
selection of tools you need, all in one 


suite- 31 components and growing! 

liwii WtfdUClMt!- 

Out of the box, the ActiveX Component 
Suite (ACS) provides instant 
programming power to reduce your 
development time. Point-and-click 
property pages, intuitive programming 
models and extensive functionality 
enable your team to add more 
functionality into your applications 
with less code. 




ed User Interface 


ProtoView’s innovative technology brings 
the familiar, easy-to-use interfaces of 
Microsoft® Outlook, Office and the 
Windows explorer to your busines 
applications. 


first Class SC 

If you run a large development team or 
have time-to-market factors, the 
ProtoView Enterprise Support Program 
will help keep you on track. This premier 
service guarantees rapid response and 
the convenience of subscription service 
so you’re always using the latest 
ProtoView tools. 

For detailed information 
and a product demo visit 
www.ProtoUiew.com 


SPEED 

LIMIT 

oo 


Download Free Trial Uersions! 
www.Protoview.com 
Order Online! 

call 800-231-8588 
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Software Tools for Component 

-Based Development- 

www.protoview.com 
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“Intelligent” Ink Dries to 
Form Nanostructures 

Regular ink, such as that deposited by 
inkjet printers, is a jumble of particles. But 
a new ink, developed at Sandia National 
Laboratories (http://www.sandia.gov/), 
self-assembles into orderly layers of 
nanosccrpic pores, which can form usable 
nanostructures. This new “intelligent” ink 
can be printed inexpensively using ordi¬ 
nary inkjet printers or with lithographic 
pens. The ability to simply print out a func¬ 
tioning nanoscopic material would be a 
tremendous time-saver over the current 
lithographic process of producing molds, 
masks, or photoresists as the first step in 
production. 

At the nanoscopic level, intelligent 
ink could be used in conjunction with 
computer-aided design software to print 
out a variety of functional structures. The 
Sandia group has developed a prototype for 
monitoring die pH of fluids transported by 
capillary action, and a structure that could 
act as a waveguide for directing laser light. 

The breakthrough is the development 
of so-called “ligands” within the ink. Lig¬ 
ands are active molecules that are able to 
bind to other molecules to form a new 
compound or complex. They can there¬ 
fore be used to analyze any gas or fluid, 
laser light, or electric or magnetic fields 
passing through. 

According to Sandia project leader Jeff 
Brinker, “We should be able to fabricate 
a substance that organizes itself to build 
a fluidic channel network instead of hav¬ 
ing to painstakingly design and cut one. 
With positive ligands in the mix to act 
upon incoming channels, we would have 
the equivalent of an analytical machine 
that built itself instead of needing con- 
staiction.” 


Europeans Look 
to Sci-Fi for New Ideas 

The European Space Agency (http://www 
.esa.int/) has launched a study of “tech¬ 
nologies and concepts found in Science 
Fiction, in order to obtain imaginative 
ideas potentially viable for long-term de¬ 
velopment by the European space sector.” 
The Innovative Technologies from Science 
Fiction for Space Applications (ITSF) study 
has opened a mailing list and a web site 
(http://itsf.spaceart.net/), where anyone 
can submit outlines of science- fiction tech¬ 
nologies. 
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“Some people tend to see Science Fic¬ 
tion as pure imagination with no serious 
scientific background,” the project’s web 
site explains. “The ITSF study is an op¬ 
portunity to see not only if SF does in¬ 
deed express ideas that are ahead of their 
time (in the Field of space technologies), 
but also whether they could actually be 
developed.” The submission form asks for 
a description of the technology, source 
and context of the idea, and a “feasibility 
assessment.” (Feasibility categories are 
“Tried & Tested,” “Under Development,” 
“Rejected as Unfeasible,” “Requires New 
Technology,” and “Untried.”) 

Among the technologies already sub¬ 
mitted are H.G. Wells’s gravity-defying 
Cavorite (Requires New Technology); 
Arthur C. Clarke’s space catapults and 
space elevators (Untried); Frank Herbert’s 
still suits (Feasibility Not Known); and 
Star Trek’s impulse drive (Under Develop¬ 
ment). In the Tried & Tested category, 
there’s Rol^ert Heinlein’s outlandish science- 
fiction premise of a Waldo. “A severe¬ 
ly disabled scientist, Waldo Farthirfgwaite- 
Jones, has to live in a zero-G space 
habitat and to develop substitutes to his 
atrophied muscles. Waldoes! Heinlein’s 
concept was successful enough for die real 
tiling, now ubiquitous, to be named after 
his character,” writes submitter Caliban. 

We look forward to the appearance of 
Soylent Green under “Enabling Tech¬ 
nologies.” 

Computer Program 
Can Act on Brain Signals 

A graduate student at the University of 
Rochester has developed a computer 
program that performs actions based on 
the recognition of brain signals. Wearing 
a virtual-reality helmet and running Jessi¬ 
ca Bayliss’s program, users have success¬ 
fully turned lights on and off and brought 
a virtual car to a stop simply by looking 
at the object to be controlled and think¬ 
ing the commands “Turn off!” and “Stop!,” 
respectively. 

Bayliss’s program is able to detect the 
brain’s weak electrical signals in a room 
full of normal activity. Previous experi¬ 
ments have required absolutely quiet en¬ 
vironments. The program listens for a 
brain signal called the “P300 evoked po¬ 
tential,” which is a signal denoting recog¬ 
nition (“That’s it!”). Combined with a per¬ 
son looking at a certain object, the 
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program can determine what action 
should be taken (turning on and off, stop¬ 
ping, and so on). 

Bayliss’s program currently works in a 
virtual apartment and requires users to 
wear helmets with dozens of electrodes 
attached to the head using a gooey gel. 
Dry sensors are expected to be available 
soon, and the next step is to try the brain 
recognition system with real objects rather 
than virtual ones. Ultimately, the system 
may be of tremendous benefit to para¬ 
lyzed people, among others. 

Inventor of Automatic 
Memory Detection Passes Away 

Richard Bloch, a pioneer in the develop¬ 
ment of digital computers, has died of can¬ 
cer at the age of 78. 

While serving as chief operations offi¬ 
cer at the Harvard University Computa¬ 
tion Laboratory in the 1940s, Bloch helped 
design and program the Mark I digital 
computer. He also invented automatic er¬ 
ror detection—parity checking—which 
is still used in most computer memory sys¬ 
tems. Bloch was a graduate of Harvard, 
and served in the Navy during World War 
II. Bloch worked at Raytheon, Honeywell. 
General Electric, and was chairman and 
chief executive of Artificial Intelligence 
Corporation and Meiko Scientific Corpo¬ 
ration. 


Ingestible Camera Could 
Replace Standard Endoscope 

Researchers at Given Imaging (http:// 
www.givenimaging.com/) have devel¬ 
oped an ingestible camera that records 
digital images of the gastrointestinal tract. 

The tiny camera and light source are 
encased in a disposable capsule that is 
swallowed like a pill. During the cam¬ 
era’s journey, patients wear a belt that 
contains a digital recording device. The 
camera provides up to six hours of con¬ 
tinuous recordings; its location is calcu¬ 
lated from the strength of the signal from 
the built-in light source. It takes about 
24 hours for the device to pass through 
the human system. The ingestible endo¬ 
scope provides a painless, convenient, 
and sterile method for testing for irregu¬ 
larities in human bowels. Given Imaging 
has successfully tested the device on hu¬ 
mans in Israel and is now working on 
obtaining FDA approval. 

http://immv.dclj.cofn 





Is your SCM system truly 

cross-platform 

or are your software development projects 

in jeopardy? 


It runs on 
more than 

40 

platforms 


“I’ll take Perforce for $600” 


Multi-platform. Perforce runs 
on more than 40 platforms, 
including Windows, Macintosh, 
every variation of UNIX you can 
think of, and more. And Perforce provides the same 
interface on all platforms. 

Scalability. Perforce routinely manages code bases 
of more than 1 million files, including source, 
document and Web content; and it scales to 
hundreds of users. 

Network efficiency. Perforce is built using a true 
TCP/IP based client/server architecture. It works 
equally well over the Internet, the office LAN and 
the global corporate WAN by using a well-tuned 
streaming message protocol for synchronizing client 
workspaces and repository contents. 

Strength. Perforce offers a strong SCM model that 
includes atomic change transactions, ensuring that 
the history of your source code can be tracked and 
easily understood. And Perforce’s unique Inter-File 



Branching™ system easily manages multiple releases 
and multi-level development lines. 


Administration. Perforce provides near-zero 
administration that means you don’t have to hire 
additional staff. And Perforce’s self-maintaining 

Play it smart with Perforce. 

database and reliable checkpoint and journal backup 
mechanism keeps your data safe. 

Download a free copy of Perforce from www.perforce.com and contact us for 
free technical support during your evaluation. That’s it. No pestering. Just the 
time and information you need to make an intelligent, informed decision. 
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United States 
Perforce Software, Inc. 
+1.510.864.7400Jel 
info@perforce.com 


Europe 

Perforce Software UK 
+44 (0) 1189.893.200_tel 
uk@perforce.com 


The Fast Software Configuration Management System 

www.perforce.com 







AMSTERDAM AUSTIN BANGALORE BEIJING BIRMINGHAM CHICAGO KUALA LUMPUR 
MELBOURNE MEXICO CITY MILAN MUMBAI NEW YORK PARIS PRAGUE SAN FRANCISCO 
SAO PAULO SEATTLE SEOUL SINGAPORE TAIPEI TEL AVIV TOKYO TORONTO 


The Power to Develop 



FREE 

Internet 
Development 
Software — 
including 
Oracle8/ 
Database — 
for all 
attendees 


. i 2000 

l Develop 


include over 40 technical presentations 

• OracleS/ — The Database for 
Internet Computing 

• Developing E-Business Portals 

• Developing E-Business Applications 
with Java and XML 

• E-Business Fast Track 
PLUS 


Toronto, Canada • June 26—27 
San Francisco • July 17-18 
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Register Now and Save! 


9 Hands-on Sessions 

* Keynotes 

• Technology Showcase 
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For full event information & registration go to: 


et.oracle.com/idevelop 


Sponsored by 
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Inside 

Xbox Graphics 

A powerful game platform 



I don’t know exactly when it was that I realized I liked pro¬ 
gramming and computers more than most people did, but 1 
know precisely when my wife figured it out. In 1980, I was 
working at a small, cash-starved consulting company that had 
a contract to put together energy-analysis software. Unfortunately, 
we couldn’t afford mainframe time to develop the program, so 
I bought a CP/M machine, set it up in my apartment, and start¬ 
ed coding. It worked great, and it was a blast having a comput¬ 
er that was all mine, every cycle, right down to the metal. 

After a few months, a deadline came up, and my friend Mike 
Koved and I worked late into the night on a simulation. After 
many hours, we started printing the results—only to find that 
the printer was horribly loud in the late-night stillness. Afraid 
we would wake the neighbors, we unzipped a sleeping bag and 
hunched over the printer with it draped over our backs, creat¬ 
ing a little hut to muffle the printer. 

It didn’t work very well, of course, and it wasn’t long before 
my wife woke up, looked at the buzzing mound of down-filled 
nylon in the living room, glanced at the clock, which read 4 am, 
said, “You’re nuts,” and went back to sleep. After that, she nev¬ 
er had any doubt where my future lay; a year later, when I sug¬ 
gested spending half of our life savings on an IBM PC so I could 
write a game for it, she never batted an eye. 

The interesting thing to me is that this story is kind of like 
buggy-whip obsolescence on fast forward. When I tell it now, 


20 years later, half the time people don’t understand why the 
printer was a problem. You see, the offending printer was a dot¬ 
matrix, and now there’s a whole generation that’s never known 
anything but laser and inkjet printers—so they’ve never had a 
printer that made any noise. Things change fast in the comput¬ 
er industry, to say the least. 

Xbox Graphics 

That story is as good a way as any to introduce Xbox graphics, 
a project I’ve been working on for the past half-year at Microsoft. 
Forget about 20 years—just four years ago, when Quake 
shipped, the state of the art for consumer 3D was a software 
rasterizer running on a Pentium Pro. In 2001, Microsoft will ship 
Xbox, a game console featuring an Intel PIII/733 with 128-KB 
cache, 64 MB of RAM, a DVD, hard disk, custom sound pro¬ 
cessor with 64 3D-audio channels, and an as-yet-unnamed 
NVIDIA graphics processing unit (GPU) with capabilities liter¬ 
ally several orders of magnitude better than Quake offered five 
years earlier. Xbox will have hardware transformation, clipping, 
lighting, curved surfaces, programmable pixel and vertex shaders, 
full-screen antialiasing, and the ability to pump out an aston¬ 
ishing number of triangles. 


Michael is a programmer at Miciosoft whew he’s recently been Hoik¬ 
ing on Xlxixgraphics. He can be contacted at mikeab@miaosoft.com. 


http://www.ddj.com 
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I’ll look at each of these in turn, but raw triangle throughput 
is the foundation on which everything else rests, so I’ll start 
there. For context, Quake on a Pentium Pro pumped out maybe 
100K triangles/second (tris/sec.) and 10M pixels/second (pix/sec.) 
at best. Shortly thereafter, the first hardware accelerators upped 
the ante to roughly 1M tris/sec. and 100M pix/sec. 

Today, both triangles and pixels per second are 
hard to capture with a single number. Triangle 
rate varies with many factors, such as 
number of textures and type of prim¬ 
itive. Fill rate is even harder to nail 
down, due to z and occlusion tech¬ 
niques that save varying amounts 
of work under different circum¬ 
stances. Matters get even more com¬ 
plicated with antialiasing, which is 
evaluated in terms of how many 
samples would have to be drawn 
with box-filtered supersampling to 
produce a visually equivalent re¬ 
sult, a measure that’s difficult to 
quantify. Finally, Xbox is not yet a 
shipping product, and the final graph¬ 
ics clock speed is still being nailed down, although it’ll defi¬ 
nitely be between 250 and 300 MHz. 

Having said all that, the Xbox GPU will be able, even at 250 
MHz, to handle up to 125 million Gouraud-shaded, two-texture 
triangles per second, complete with transformation, clipping, 
and perspective projection. With one infinite hardware light 
added, the rate will be at least 62.5 Mtris/sec.; with eight local 
lights, at least 8 Mtris/sec. 

The GPU’s raw' fill rate at 250 MHz will be 1 Gpix/sec. To 
provide some context for that number, at a resolution of 640x480, 



Figure 1: Xbox block diagram . 


it is sufficient to draw every pixel on the screen more than 50 
times per frame, at a frame rate of 60 Hz. (TV is the normal 
Xbox output device, although HDTV and VGA monitors are sup¬ 
ported. TV is interlaced, but Xbox will normally render nonin¬ 
terlaced, then filter the interlaced fields from the full frame, so 
I’ll use full 640x480 TV-frame resolution in this article.) There’s 
also occlusion-detection circuitry that can increase fill rate 
by up to 4X; the effect varies depending on whether 
pixels are occluded when dney’re drawn, 
but tends to be greatest exactly when 
it’s needed most—when there’s a lot 
of overdraw. Finally, antialiased draw¬ 
ing can produce still higher equiva¬ 
lent fill rates. Those numbers are of 
interest mainly for marketing pur¬ 
poses; from a developers perspec¬ 
tive, the important stat is that the 
GPU will support antialiased TV ren¬ 
dering at a full 60 Hz, even with 
10-50X overdraw of every pixel on 
the screen. 

To put that into easily visualized 
terms, Quake on a Pentium Pro could 
draw about three lit player models per frame at 640x480, 60 Hz. 
Xbox should be able to draw roughly 3000 of the same mod¬ 
els per frame, even with a second texture, pixel shading, and 
antialiasing thrown in for good measure. 

Lies, Damn Lies, and Graphics Chip Specs 

At this point, you might reasonably be wondering how much 
of the theoretical performance of the GPU Xbox games will ac¬ 
tually be able to achieve. There are several factors that can po¬ 
tentially keep the GPU from ainning at full speed, but a sur¬ 
prisingly large fraction of theoretical performance really will be 
available. 

Memory size and performance, CPU performance, and bus 
bandwidth are all potential bottlenecks; see Figure 1. It’s cer¬ 
tainly true that it will be a challenge to fit databases for scenes 
with more than a million visible triangles into Xbox’s 64 MB of 
memory; however, texture and vertex compression and reuse, 
as well as curved surfaces, will help considerably. It’s equally 
true that the CPU can’t support anything like full GPU perfor¬ 
mance, particularly because it has only 1 GBps front-side-bus 
(FSB) bandwidth to memory. At roughly 26 bytes/tri., that’s only 
enough bandwidth for 38 Mtris/sec. at best. However, in the 
highest-performance applications, most of the triangle data won’t 
be coming from the CPU; it will consist of static meshes pulled 
directly from memory by the GPU. Don’t be confused by the 
term “static”— these meshes are processed according to the cur¬ 
rent transform, complete with skinning, so they can readily sup¬ 
port animation of jointed models. It is with this sort of render¬ 
ing that Xbox will really shine: Think of the droid army in Ibe 
Phantom Menace , with thousands of entities, each drawn from 
the same set of jointed elements, but with different shading and 
positioning of those elements. 

That leaves one potential bottleneck, and it’s a big one— 
memory bandwidth. Xbox has a unified memory architecture 
(UMA), whereby the GPU and CPU share a single memory space, 
with memory control provided by the GPU. This is in marked 
contrast to the separate memories used for high- performance 3D 
in PCs. UMA has a significant advantage in that it allows tine CPU, 
DVD and disk controllers, and GPU to access common data with¬ 
out copying; for example, models and textures can be streamed 
off the DVD into memory and used directly by the GPU. How¬ 
ever, tine history of UMA is spotty; witness IBM’s PCjr UMA, wlnich 
stopped the CPU virtually dead in its tracks by allotting two out 
of every three memory cycles to graphics. Not surprisingly, this 
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“The difference between delivering 
a good Java™ app and a great one!” 


ComputerWire 00 Tools Bulletin 



JClass 


JClass Enterprise Suite 4.5 

First to develop third-party JavaBeans. First to provide support for Swing. 
First to provide support for Java 2. We could go on. At KL Group, we take 
leadership in Java components seriously. Very seriously. And with the 
release of JClass Enterprise Suite 4.5, the world’s leading components just 
got better. Again. Everything the serious Java developer needs to create 
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(continued from page 22) 

is the aspect of )d>ox that has aroused the greatest degree of 
public skepticism, so the accompanying text box entitled “Xbox 
Memory Bandwidth" discusses Xbox’s memory bandwidth in 
high-end scenarios. The short version of the bandwidth story is 
that while there are scenarios in which Xbox could run out of 
bandwidth, there should be more than enough for most cases, 
particularly those that leverage the GPU’s programmable pipeline. 
Under virtually any set of assumptions, Xbox has adequate mem¬ 
ory bandwidth to handle 50 Mtris/sec. in real-world use, and 
usually plenty to hit the pipeline limits of the chip. 

Xbox also offers support for 125 million particles—single¬ 
color, front-facing squares—per second. The particle control struc¬ 
ture is considerably smaller than that of a triangle, letting the CPU 
generate many more particles per frame than would be possible 
with triangles. This makes particles well suited for procedural ef¬ 
fects such as smoke, fire, and flowing and splashing liquid. 

The bottom line is that Xbox is a well-balanced graphics sys¬ 
tem that will generally be capable of approaching the specs be¬ 
ing claimed for it. “Capable” is not the same as “easy”— this lev¬ 
el of performance will require exemplary programming, taking 
full advantage of the fact that Xbox is a fixed platform to which 
code can be carefully tuned. Microsoft will encourage this by 
providing plenty of sample code and documentation showing 
how to push the hardware to its limits, via a version of DirectX 8 
optimized and extended to support every feature of Xbox. For 
those who prefer OpenGL, NVIDIA will provide a fully Xbox- 
enhanced version. 

Lots of Triangles-And Good-Looking Ones, Too 

When it comes to triangles, quantity matters a lot, but quality 
matters as well. Xbox offers a number of quality-enhancing fea¬ 
tures, such as perspective-correct interpolation of all attributes, 
^-buffering, and shaders. The quality feature that will surely 
have the broadest and most visible impact, however, is full¬ 
screen antialiasing, which addresses the most glaring rendering 
artifact of the current generation of graphics hardware: crawl¬ 
ing jaggies along the edges of objects. 

When enabled, Xbox’s antialiasing will automatically be per¬ 
formed for the entire scene, writing either two or four samples 


Vertices In 



Memory 


Figure 2: Xbox GPU graphics pipeline block diagram. 
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per pixel (whichever the programmer chooses), with no game 
programming changes required. The impact is greater than sug¬ 
gested by the relatively modest increase in sample rate; the set 
of samples per pixel and the filtering that converts the samples 
to pixels, taken together, produce results substantially better than 
two- or four-sample box filtering. 

There are three costs to using antialiasing: larger pixel and z 
buffers; the need for a filtering bit from the pixel buffer to the 
frame buffer; and a performance cost because more pixel and 
z samples need to be handled per pixel. As noted in “Xbox 
Memory Bandwidth,” however, the cost of the pixel buffer can 
be cut in half by using 16-bpp pixels, with no appreciable loss 
in quality, so for two-sample antialiasing, the memory cost is 
only 1.2 MB; for four-sample antialiasing, it’s 4.8 MB. The fil¬ 
tering bit takes less than 4 percent of total memory bandwidth 
at most. As for rendering performance, the pipeline can actual¬ 
ly process antialiased pixels just as fast as nonantialiased. The 


only cost from the additional samples is memory bandwidth, 
and, as “Xbox Memory Bandwidth” shows, pixel and z access¬ 
es are not the largest consumers of bandwidth. The upshot is 
that there will be only a modest slowdown associated with an¬ 
tialiasing, especially the two-sample version. 

Not Your Father's Pipeline 

The final major feature of the GPU is a new kind of graphics 
pipeline, featuring far more programmability than the pipelines 
we’re used to. There’s no way I can discuss it in detail here, but 
I’ll provide an overview, and point you to sources for more in¬ 
formation. 

Figure 2 shows the six major components of the pipeline. Of 
these, only the alpha blender and rasterizer match the current 
generation of graphics hardware. The remaining four compo¬ 
nents constitute a significant break with the past, mirroring the 
radical changes in DirectX 8 from DX 7. 


Xbox Memory Bandwidth 


U MA doesn’t slow Xbox down be¬ 
cause the Xbox GPU has several 
bandwidth-saving features. Also, 
Xbox has extremely high memory band¬ 
width, thanks to its 128-bit-wide 200 
MHz double-data-rate memory, which 
yields 6.4 GBps. To illustrate how this 
works, let’s try to push the GPU to the rar¬ 
efied level of 100-million Gouraud- 
shaded, two-texture triangles per second 
(tris/sec.). Note that this is a simplified dis¬ 
cussion; there are many internal factors that 
can have an impact, such as cacliing, mem¬ 
ory access patterns, and texture format, but 
that’s far too complex to get into here. 

For starters, memory usage won’t be 
perfectly efficient, so let’s assume 5.1 GBps 
is actually available. Next, as shown in Fig¬ 
ure 1, a maximum of 1 GBps is allocated 
to the CPU, with CPU requests getting 
higher priority than the graphics pipeline. 
The CPU will rarely use its full allocation 
(which is considerably more than most 
current PCs support), but let’s allocate the 
full lGBps anyway. 

That leaves 4.1 GBps for the graphics 
and audio controllers. We’ll allocate 25 
MBps for audio and 75 MBps for video 
output, leaving 4.0 GBps for the graphics 
pipeline. 

We’ll have to make some assump¬ 
tions here. Let’s say the triangles to be 
drawn are stored indexed meshes, with 
a vertex:triangle ratio of 0.625:1 (the GPU 
peaks at 62.5 Mverts/sec. with this many 
vertex attributes, so we’re maxing out ver¬ 
tex processing), 32 bytes/vertex (a; y, z, 
four texture coordinates, one color), and 
6 bytes/triangle for indices, all fetched di¬ 
rectly by the GPU. This yields about 26 
bytes/triangle, so drawing 100 Mtris/sec. 
requires 2.6 GBps just to fetch the trian¬ 
gles, leaving 1.4 GBps unallocated. 


Texturing is the next bandwidth sink. 
For simplicity, let’s assume a texel: pixel ra¬ 
tio of 1:1, with 32-bit pixels, texels, and z. 
Let’s further assume that the screen is over¬ 
drawn 10 times/frame, so each triangle is 
roughly 1.8 pixels in size. (That might 
sound small, but when you’re dealing with 
more than 1.5 Mtris/frame, the individual 
triangles won’t be veiy large.) Then the 
raw texture bandwidth would be mice 
the 720 MBps drawn-pixel rate (because 
there are two textures). However, the GPU 
supports DirectX texture compression, so 
textures will typically be compressed by 
75 percent. This leaves us with texture 
bandwidth at 360 MBps, which reduces 
to 90 MBps due to early z processing that 
avoids unneeded texture reads assuming 
z rejection three-quarters of the time (rea¬ 
sonable with 10X overdraw). The same as¬ 
sumption reduces pixel bandwidth to 180 
MBps. Finally, there’s 900 MBps for the z- 
buffer (again assuming z rejection three- 
quarters of the time), putting us pretty close 
to our bandwidth budget. 

There’s a trick, though—automatic z 
compression that cuts z-buffer bandwidth 
by 60 to 65 percent. This reduces z-buffer 
bandwidth to about 330 MBps, for a total 
of 600 MBps used by this part of the 
pipeline—making it with 800 Mbps to 
spare. So Xbox has plenty of bandwidth 
to render 100 Mtris/sec. But what happens 
when we turn on antialiasing? 

The bandwidth requirements for an¬ 
tialiasing are the same as mentioned ear¬ 
lier, except for pixel and z-buffer band¬ 
width. Textures don’t need to be any more 
detailed, because they ultimately relate to 
actual pixel size and are already filtered. 
The GPU supports two- and four-sample 
antialiasing, so there are two analyses to 
perform. 


For the two-sample case, the pixel 
buffer stays the same size, because 16-bit 
dithered pixels can be used; filtered to¬ 
gether, these provide adequate informa¬ 
tion for a 32-bit pixel. Z-buffer bandwidth 
doubles, to 660 MBps, and 150 MBps is 
needed for the bit that filters die samples 
into pixels, but we still have 320 Mbps to 
spare. 

Finally, we come to four-sample an¬ 
tialiasing, for which we pull another rab¬ 
bit out of our hat: a switch from 32-bit z- 
buffering to 16-bit ^buffering, at the cost 
of losing the stencil buffer, ^-buffering 
keeps the z-buffer bandwidth at two- 
sample levels, letting us sneak under the 
wire, despite an extra 75 MBps for the fil¬ 
ter bit and 180 MBps for pixel writes. 

In general, though, bandwidth is not 
nearly as tight as it seems. I intentionally 
chose an unusually tough scenario and 
didn’t employ vertex compression, both 
to be conservative and because it’s simi¬ 
lar to what current games do. However, 
high-end Xbox programming will be dif¬ 
ferent from current 3D. Because of the 
power of the shaders and the vast band¬ 
width difference between the CPU and 
GPU, the key to Xbox graphics perfor¬ 
mance will be getting the CPU out of the 
loop by using static meshes and moving 
calculations from die CPU to the vertex 
and pixel shaders. With this approach, a 
vertex might consist of a compressed 6- 
or 12-byte coordinate and a compressed 
4- or 6-byte normal, with lighting and tex¬ 
ture coordinates calculated by the GPU; 
there’s a gigabyte or more of bandwidth 
to spare widi the resulting 10- to 18-byte 
vertices. 


—M.A. 
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The GPU is DX 8 compliant (with some extra features tossed 
in), so the DX 8 specification is an excellent reference for the 
chip, especially the new components. As I write this, DX 8 is in 
beta and can only be obtained under nondisclosure agreement, 
but it should become widely available sometime soon; check 
out http://msdnmicrosoft.com/directx/. Also, the GPU 
has the same pipeline features as NVIDIA’S 
upcoming next-generation PC 
chip, so information about 
that chip (at http://www 
.nvidia.com/developer/) will 
be applicable to Xbox as well. 

There’s already considerable 
information on the aforemen¬ 
tioned web site about GeForce 
and GeForce 2 GTS, which 
contain a subset of the Xbox 
GPU’s pixel and vertex 
shaders. 

Starting with the first new part of the pipeline, the surface 
engine is pretty much what you’d expect. It works with the 
CPU to tessellate high-order surfaces such as Catmull-Clark, 
Bezier, Loop, and uniform B-splines, at a maximum rate of at 
least 50 Mtris/sec. 

The vertex shader is a programmable SIMD engine with 
storage for 192 quadwords of data and 128 app-downloadable in¬ 
structions, which specify the program to be executed on each 
vertex. The vertex shader can do standard transformation, clip¬ 
ping, and lighting, but that’s just the start. Some other appli¬ 
cations include vertex blending, morphing, animation, skin¬ 
ning, elevation fog, mesh warping (procedural waves, for 
example), procedural texture-coordinate generation (such as 
reflection maps), and arbitrary lighting techniques. 

The texture unit supports up to four textures per pixel. Two 
textures can be handled in a single clock; tltree or four textures 
take two clocks. 3D textures and cube maps are also supported. 

The radical feature of the texture unit is that the output of one 
texture can serve as a coordinate for 
another texture, effectively allowing 
a texture to be used as a one-, 
two-, or three-dimensional 
lookup table. Cube maps can be 
used to perform additional com¬ 
putations as part of the lookup; 
for example, a texture can be 
used in conjunction with a cube 
map to normalize vectors to unit 
length, which is very handy for 
lighting via dot products. 

You can think of the pixel 
shader as a compact but power¬ 
ful programmable pixel proces¬ 
sor that runs a nine-instruction 
program on each pixel. It con¬ 
sists of eight register combiners 
cascaded together, with each taking 

inputs from up to four textures (which themselves may have 
been cascaded together as noted earlier), and also from con¬ 
stants, interpolated values, and scratch registers. I’d love to 
show you a figure that sums up the pixel shader, but unfor¬ 
tunately it’s just too complicated for that; however, there are 
already several relevant papers, with a good set of figures, on 
http://www.nvidia.com/developer/, and more to come. Many 
of the registers are writable by the combiners, so combiners 
can send outputs to later combiners through the registers, which 
thereby represent the state of each pixel as it passes through 
the pixel shader. Each combiner takes up to four RGB inputs, 


and can perform two three-element multiplies or dot products, 
add the two products, and output up to three values: the over¬ 
all result and the results of the two multiplies. (A limited form 
of conditional output is also possible.) There’s a parallel, sep¬ 
arately configurable set of eight alpha combiners. Which com¬ 
biners are active, what they do, and where their data comes 
from and goes to is fully pro¬ 
grammable. The pipeline runs 
at full speed with up to two 
active combiners, takes two 
cycles with up to four com¬ 
biners, three cycles up to six 
combiners, and four cycles 
above that. 

Lastly, the final combiner 
performs a similarly pro¬ 
grammable operation on the 
output of the last active com¬ 
biner stage, and sends the re¬ 
sult to the alpha blender. However, this stage has additional 
components for specular and fog. 

If this sounds weird, well, it is. It’s a far cry from the fixed- 
function pipelines we’re used to, and it’s not immediately ob¬ 
vious how all this programmability can be applied. For starters, 
though, note that the programmable pipeline supports all the 
capabilities of DX 7, so it’s a superset of the standard pipeline. 
It’s also capable of supporting stuff like diffuse and reflective 
bump mapping, shadow maps, fresnel effects, Phong shad¬ 
ing, z-correct bump mapping, and even some forms of BRDF 
shading, which makes it possible to do sophisticated materi¬ 
als such as velvet, wood, and aluminum. Take a look at the 
GeForce samples on NVIDIA’s web site; you’ll be astonished 
at what even a small subset of the Xbox GPU’s pipeline can 
do. NVIDIA suggests that you stop thinking of parts of the 
pipeline as “color interpolators,” “bump mappers,” and the 
like, and start thinking of the pipeline as a set of resources 
that can be combined to enable a whole new set of capabil¬ 
ities. As for exactly what those might 
be, no one really knows, and 
that’s the most exciting part of 
all. For several years now, fixed- 
function hardware has restricted 
developers’ flexibility and cre¬ 
ativity in 3D rendering, but sud¬ 
denly there’s a whole new world 
to explore, and a new set of 
tricks to figure out. 

Looking Ahead 

The best thing about Xbox is 
that it won’t change. Ever. Judg¬ 
ing by other consoles, Xbox 
should have a four or five year 
run, and wonderful as the pro¬ 
fusion of constantly evolving PC 
technology is, I love the idea of being 
able to spend years working with a high-powered, fixed plat¬ 
form— figuring out how to apply all that programmability, 
understanding the performance quirks, getting things right. 

It’s a long way from hunching over a dot-matrix printer. Still, 
there’s a key similarity. Twenty years ago, I loved the feeling of 
having all that computer power at my command, and the part 
that really rocked was figuring out how to use it— all of which 
goes double for Xbox. 


DDJ 
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Triangle 

Intersection Tests 


Where does 
that point lie? 

Eric Haines and Tomas Moller 

A n important and commonly per¬ 
formed operation is testing whether 
a point is inside a triangle. In this ar¬ 
ticle, we will discuss 2D and 3D cas¬ 
es of this operation and present methods 
that also give a measure of the point’s lo¬ 
cation relative to the triangles edges and 
vertices. 

2D Point-Triangle Test 

A classic method of testing whether a point 
is inside a triangle, defined by three points, 
po . Pb an d Pb is to send an imaginary ray 
from die point outwards to infinity. If this 
test ray crosses an odd number of edges, 
the point is inside the triangle. This test 
also works for polygons or any closed- 
curve figure. However, since diis algorithm 
has been examined many times before (see 
“Point in Polygon Strategies,” by Eric Haines 
in Graphics Gems IV , edited by Paul S. 
Heckbert, AP Professional, 1994, http:// 
www.acm.org/tog/GraphicsGems/; and 
Real-Time Rendering, by Tomas Moller and 
Eric Haines, A.K. Peters, 1999), we will fo¬ 
cus on a comparable mediod diat has some 
additional useful features. 

The algorithm we’ll discuss here is 
based on using barycentric coordinates. 
A point, (u,v), on a triangle is given by 
the explicit formula i(u,v)=(l- u-v)p 0 + 
iip\+vpi, where (u,v) are the barycen¬ 
tric coordinates, which must fulfill u> 0 , 
v>0, and u+v< 1. That is, u or v is the 


Eric and Tomas are the authois of Real- 
Time Rendering (A.K. Peters, 1999). 
They both can be contacted at http:// 
ivww. realtimerenderi ng.com/. 
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amount by which to weigh the corre¬ 
sponding vertex’s contribution to a par¬ 
ticular location, with (1- u-v) being the 
weight for the third vertex. Figure 1 
shows the coordinate system in terms of 
u and v. Note that (u,v) can be used for 
texture mapping, normal interpolation, 
color interpolation, and so on. 

To test whether a point is inside a tri¬ 
angle is straightforward. If the point ful¬ 
fills the conditions just given, then it must 
be inside the triangle. But how do you 
determine u and v ? The answer is to 



transform the test point into a coordi¬ 
nate system based on the axes defined 
by the u and v values. Example 1 is 
pseudocode for testing some point i for 
inclusion in a triangle. 

For simplicity of presentation, inter¬ 
mediate results are all computed at the 
start of Example 1, in steps 1-3. In the 
actual code, these are computed only as 
needed. Step 4 tests whether p 0 and p x 
have the same x-coordinate (a possibly 
common case). Step 5 checks if all three 
x-coordinates are the same; if so, the tri¬ 
angle has no area. Steps 7 and 10 check 
if u and v are in bounds. The u=l test 
in step 7 is not strictly necessary, but of¬ 
ten quickly helps classify points as be¬ 
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ing outside the triangle with little addi¬ 
tional work. Our goal is to exit the rou¬ 
tine as soon as possible to avoid addi¬ 
tional computations. Steps 12 through 17 
are for computing the common case, and 
involve a little more computation. Step 
18 checks the third edge of the triangle 
against the test point. Steps 5, 8, and 13 
test if the triangle has zero area; testing 
for closeness to zero with some very 
small number e may be preferable for 
robustness. 

For a full derivation of the math in¬ 
volved in deriving this algorithm, see Di- 
dier Badouel’s presentation, “An Efficient 
Ray-Polygon Intersection” and Graphics 
Gems, edited by Andrew S. Glassner, Aca¬ 
demic Press, 1990, http://wnvw.acm.org/ 
tog/GraphicsGems/. Tlie code presented 
here is a more efficient version of Badouel’s. 

3D Ray-Triangle Test 

A common method of testing whether a 
ray intersects a triangle is to intersect the 
ray with the plane the triangle defines, 
then determine whether the point of in¬ 
tersection within the plane is inside the 
triangle (see “Essential Ray Tracing Algo¬ 
rithms,” by Eric Haines in An Introduc¬ 
tion to Ray Tracing, edited by Andrew 
Glassner, Academic Press, 1989, http:// 
www.education.siggraph.org/materials/ 
HyperGraph/raytrace/rtinterO.htm). This 
second step is done by dropping one of 
the three coordinates of the vertices and 
point involved, thereby turning this into 
a 2D problem, which we solved in the 
previous section. (This algorithm was first 
presented by Moller and Trumbore in 
“Fast, Minimum Storage Ray-Triangle In¬ 
tersection,” Journal of Graphics Tools, 
2(1), 1997.) There is a more elegant so¬ 
lution, however, which has the added ad¬ 
vantage of not needing to precompute 
and store the plane’s normal. In addi¬ 
tion, barycentric coordinates are gener¬ 
ated for the intersection point. 

To compute the intersection between 
a ray and a triangle in three dimensions 
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(continued from page 32) used to transform as we wanted. Essen- 

using this newer method, we need to re- tially, this is just how the multiplication of 

view a little linear algebra. Assume that we a matrix by its inverse (where the result 

have three vectors, /% ^i, and m 2 , that of the multiplication is equal to the iden- 

make up a basis (a frame of reference). To tity matrix) is interpreted geometrically. A 

transform the vectors of this basis so that fine thing about this property is that it 

they become mutually perpendicular and works as long as the vectors do not all lie 

align with the x-, y- and z-axes, we first in the same plane. The basis transform is 

form a matrix M=(m 0 m 1 m 2 ), where the illustrated in Figure 2. 

basis vectors thus form columns in die ma- Now to the problem that we want to 
trlx. Then the inverse of this matrix can be solve. We have a triangle defined by three 


(u=0, v=1) 


P2 

V=1 

u=° / k 

u+v=1 

/--• i 

k U=1 


Po 

(u=0, v=0) V ° 

Pi 

(u=1, v=0) 


Figure 1: Barycentric coordinates for a triangle. 



bool PointlnTriangle (i, p 0 , p lt p 2 ) 


returns ({TRUE. FALSE}.u.v); 

1 

e a = i"P0 

2 

e i = Pi"P0 

3 

e 2 =p 2 -p0 

4 

if (elx=0) 

5 

if (e 2x =0) return (FALSE,0,0); 

6 

u=e 0x/ e 2x 

7 

if (u<0 or u>l) return FALSE,0,0); 

8 

if (e ly =0) return FALSE,0,0) 

9 

v=( e 0y -e2 yu )/ei y 

10 

if (v<0) return (FALSE,0.0); 

11 

else 

12 

d = e 2y e lx~ e 2x e ly 

13 

if (d=0) return (FALSE.0,0); 

14 

u = (eeyeu-e^ejyJ/d 

15 

if (u<0 or u>l) return (FALSE,0,0); 

16 

v = (e 0x -e 2x u)e lx 

17 

if (v<0) return (FALSE.0.0); 

18 

if (u+v>l) return (FALSE.0.0); 

19 

return (TRUE,u,v); 


Example 1: Pseudocode for testing some point i for inclusion in a triangle. 



Figure 2: (a) A basis formed by m 0 , m h and m 2 . To make it aligned with the x-, 
y- and z-axis, we multiply with the inverse of the matrix M=(m 0 irq m 2 ), and 
obtain the result in (b). 


points: po,p\, and p 2 (in counter-clockwise 
order if seen from the front), and we have 
a ray r(t)=o+td, where o is the origin of 
the ray, d is the normalized direction vec¬ 
tor of the ray, and t is the parameter of 
die ray equation (diat is, the distance along 
the ray). This situation is illustrated in the 
upper left of Figure 3. The task is to com¬ 
pute whedier the ray intersects the trian¬ 
gle, and if so, also compute the distance 
to the intersection point and the barycen¬ 
tric coordinates of it. 

To solve this problem we first translate 
the triangle vertices and the ray by -p 0 so 
that the first triangle vertex ( p 0 ) is at the 
origin. This is depicted in die upper right 
of Figure 3. Now’ we form a basis from -d, 
pi~po, and p 2 -po, and transform the trans¬ 
lated origin, o-p 0 , with die inverse of diat 
matrix. This is shown in the lower left of 
Figure 3 and in Example 2. 

So now' w r e only have to interpret what 
die resulting vector w is. Looking at die low ¬ 
er right of Figure 3, this is quite simple. The 
x-component of w is the positive distance 
from the ray origin to the front facing tri¬ 
angle, which means diat it is actually the 
value of die t parameter of die ray equa¬ 
tion. The y- and the z-components of w 
are the barycentric coordinates for die in¬ 
tersection point; that is, it must hold that 
w y > 0, w z > 0, and w y +w z <A if the inter¬ 
section point is to be inside the triangle. 
w y and w z are denoted here instead as u 
arid v. This means that w=(t,u,v) T , where 
t is the distance to the intersection point, 
and (u,v) are the barycentric coordinates 
of die intersection. 

At this point you might argue that this 
is all very well in theory, but solving Ex¬ 
ample 2 involves the inversion of a 3x3 
matrix, which is not considered a fast op¬ 
eration. However, it turns out that there 
are many factors that can be reused if the 
matrix is solved with Cramer’s rule for 
matrix inversion. If w r e denote e\=pi-p 0 , 
e 2 =p 2 ~Po, and s=o-p 0 , dien the solution to 
Example 2 is in Example 3, w'here det( ) is 
the determinant of three vectors. Knowing 
diat det(a, b, c)=(a x b)*c=-(axc)*b-(cxb)*a, 
Example 3 is restructured as in Example 



Example 2: Translating the triangle 
vertices. 



Example 3: Solution to Example 2. 
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(continued from page 34) idea of the code is to compute a value, 

4, where r=dxe 2 and q=sxe\. This last check if it is within its valid bounds, con- 

expression is what we need in order to tinue if it is, and otherwise exit, 

make an efficient implementation of the Before showing the pseudocode, we 
ray-triangle intersection test. Recall that will present a few more optimizations, 

it is important to jump out of the code First, if we care only about intersecting 

as soon as we can find out that we do front-facing triangles, we can test if the 

not have an intersection. So the main determinant is less than a very small 



Example 4: Restmctured Example 3- 



Example 5: Checking front- and back-facing thangles. 



Figure 3: The entire transform for computing the intersection between a ray 
and a triangle in three dimensions (read from left to tight, top to bottom). 


number, 8. If it is, then exit, since a neg¬ 
ative determinant means that the basis is 
negatively oriented, which in turn means 
that the ray hits the back face of the tri¬ 
angle. On some modern CPU architec¬ 
tures, division is done in parallel with 
other operations, so dividing early and 
using the result much later can be ad¬ 
vantageous. 

When we care about both front- and 
back-facing triangles, we can do the di¬ 
vision quite early in the code, but use 
its result as late as possible — hoping 
that the division is computed by then; 
see Example 5. 

Lines 1 and 2 compute two of the 
edges of the triangle, while lines 3 and 
4 compute the determinant a. Line 5 
computes the difference between the ray 
origin and the first triangle vertex. The 
inverse of the determinant f is comput¬ 
ed at line 6. This division usually takes 
many cycles, but because we only need 
its result at lines 23-25 (if we reach that 
point in the code), we may hope that it 
is finished or at least close to finished at 
that point. This turned out to be about 
5-10 percent faster than the original im¬ 
plementation, but this depends on the 
CPU architecture and on the percentage 
of intersections. Line 7 computes q, 
which later is used to compute v. What 
follows at line 8 is a test on the deter¬ 
minant, and if that branch is taken the 
triangle is front facing. The else branch 
is taken for a negative determinant (back- 
facing triangle), and thus we have 
changed from less than to greater than 
and vice versa in the inner if statements. 
At line 22 we know that the determinant 
was close to zero, and thus the triangle 
was close to or parallel to the ray direc¬ 
tion. If we have not exited from the 
code, lines 23-25 compute the final re¬ 
sult (t,u,v). All that is needed to get the 
values of u and v at this point is to mul¬ 
tiply with the inverse of the determinant. 

The source code is available electroni¬ 
cally; see “Resource Center,” page 5. Some 
lines can be swapped without altering the 
final result, but your CPU architecture may 
favor a certain order. 

Further Reading and Resources 

In Real-Time Rendering (A.K. Peters, 
1999), we describe related tests in more 
detail. The book covers a wide variety 
of other intersection tests and methods; 
see http://realtimerendering.com/. For code 
for other intersection tests, we recommend 
visiting the Graphics Gems web site at 
http://www.acm.org/tog/GraphicsGems/ 
and Magic software at http:/Avww.magic- 
software.com/. 


DDJ 
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Optimizing 3DNow! 
Real-Time Graphics 


Floating-point SIMD 
extensions make 
the difference 

Max I. Fomitchev 

B ecause computationally expensive ap¬ 
plications (engineering CAD systems, 
scientific and statistics applications, 
3D grapliics, 3D modeling, 3D games, 
and the like) rely on floating-point oper¬ 
ations, most modern processors are de¬ 
signed to support high floating-point per- 
fonnance, wliile still providing support for 
the familiar x87 instruction set. However, 
the increasing demand for real-time 3D 
graphics and image processing is driving 
CPU design toward highly optimized, ful¬ 
ly pipelined floating point. It takes the 
AMD Athlon and Pentium III, for instance, 
only one cycle to add two floating-point 
numbers, and one and two cycles, re¬ 
spectively, to multiply them. Not bad— 
but still not good enough for real-time 3D 
graphical applications. 

One approach to pumping up real-time 
3D grapliics performance Is AMD’s 3DNow! 
technology, wliich adds floating-point SIMD 
extensions to the original x86 instaiction 
set. This approach addresses die need for 
high-performance floating point by ex¬ 
ploiting the natural parallelism of floating¬ 
point calculations and allowing execu¬ 
tion of up to four single-precision (32-bit) 
floating-point operations per clock cycle. 


Max is a computer consultant and senior 
research associate with Ultrason image 
processing. He can be contacted at maxj ® 
webzone.net. 
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This meaas diat 3DNow! teclinology makes 
it possible to crunch numbers 2-4 times 
faster than with ordinary x87 instaictions. 
In this article, I’ll examine 3DNow! tech¬ 
nology, then provide guidelines for opti¬ 
mizing its performance even more. 

AMD is one of a number of vendors 
supporting the 3DNow! instruction set. 
IDT WinChip provides full support for 
3DNow! technology, Cyrix plans to im¬ 
plement the 3DNow! instruction set in its 



future Gobi and Mojave CPUs, and 
3DNow!-optimized display drivers are 
available from grapliics card vendors such 
as 3dfx Interactive, ATI Technologies, Ma¬ 
trox, NVIDIA, Creative Labs, Diamond 
Multimedia, and more. Microsoft supports 
3DNow! in DirectX 6, while SGI provides 
support for it in OpenGL. 

Instruction Set Overview 

Table I lists the 3DNow! instructions, all of 
which operate on MMX registers MMO- 
MM7. Most 3DNow! instructions operate 
on pairs of 32-bit single-precision, floating¬ 
point numbers packed in a 64-bit quad- 
word; see Figure 1. The exceptions are 

Dr. Dobb’s Journal , August 2000 


PAVGUSB and PMULHRW, wliich operate 
on packed 8- and 16 -bit integers, respec¬ 
tively. (These instructions actually extend 
the original MMX instruction set and are 
not discussed in this article.) Data is loaded 
to/stored from MMX registers using MOVD 
and MOVQ. MOVD can be used to load a 
single 32-bit floating-point value to an MMX 
register, wliile MOVQ loads a pair of such 
values. With MOW operations, it is pos¬ 
sible to use the 3DNow! instructions in 
place of the x87 instructions to operate 
on single-precision numbers in a non- 
SIMD way. 

The PI2FD and PF2ID instructions pro¬ 
vide a useful interface for converting 
to/from 32-bit integer data. These in¬ 
structions are similar to FILD/FIST x87 op¬ 
erations. PSWAPD, an extension to the 
original 3DNow! instaiction set, lets you 
avoid reverse vector processing by swap¬ 
ping upper and lower double words of 
the source operand. 

PI2FW and PF2IW were introduced in 
the Athlon CPU and simplify interface be¬ 
tween MMX integer math and 3DNow!. 
These instructions provide conversion 
to/from 16-bit integers. 

PFCMPEQ, PFCMPGE, and PFGMPGT are 
similar to the PCMPEQD and PCMPGTD 
MMX instructions, except they operate on 
packed floating-point operands. The des¬ 
tination operand is set to all Os or all Is, 
depending on the result of comparison. 

PFMAX and PFMIN select maximum/ 
minimum values from two pairs of packed 
floating-point numbers. 

PFRCP, PFRCPIT1, and PFRCPIT2 cal¬ 
culate the reciprocal of the scalar 
operand. At a glance, it is a surprise to 
see three instructions that calculate the 
reciprocal. However, each instruction cal¬ 
culates the reciprocal with different pre¬ 
cision. The reciprocal calculation is ini¬ 
tiated by PFRCP. It takes one cycle to 
complete and the result is 14-bit accurate. 
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(continued from page 40) 

Successive execution of PFRCPIT1 and 
PFRCPIT2 makes the result 24-bit accu¬ 
rate (but not fully accurate). 

The main purpose of PFRCPxx (see List¬ 
ing One) is division facilitation. Each it¬ 
eration step takes only one clock cycle to 
complete. This makes three cycles for 
pipelined full-precision reciprocal calcu¬ 
lation. Moreover, it is possible to improve 
the performance when lower 14-bit pre¬ 
cision is sufficient. Also, having three re¬ 
ciprocal calculation instructions provides 
more control over instruction scheduling. 

Flowever, even after three iteration steps 
the reciprocal results are not absolutely 
accurate. The estimate contains the cor¬ 
rect round-to-nearest value for approxi¬ 
mately 99 percent of all arguments. The 
remaining arguments differ from the cor¬ 
rect round-to-nearest value for the recip¬ 
rocal by 1 unit-in-the-last-place (error in 
the last digit). Thus, when porting x87 
code to 3DNow!, the computational re¬ 
sults may be slightly different. Whether 
the error is negligible depends on the ap¬ 
plication precision requirements and se¬ 
lected numerical method. 

In some cases, it is possible to avoid 
floating-point division completely by com¬ 
puting reciprocals beforehand and using 
floating-point multiplication with precal¬ 
culated, fully accurate reciprocals. 

PFRSQRT and PFRSQIT1 calculate the 
square root reciprocal of the scalar 


operand. These instructions are similar to 
the PFRCPxx operations. The last iteration 
is affected through the PFRCPIT2 instruc¬ 
tion. After all three iterations, die square 
root reciprocal of the operand is 24-bit ac¬ 
curate. For example, Listing Two calcu¬ 
lates square root. The square root/square 
root reciprocal estimate contains the cor¬ 
rect round-to-nearest value for approxi¬ 
mately 87 percent of all arguments. 

The reciprocal and the square root re¬ 
ciprocal calculation procedures are some¬ 
what awkward and must be followed pre¬ 
cisely. The results of PFRSQIT1, PFRCPIT1, 
and PFRCPIT2 iteration are not defined 
for arguments other than those produced 
by PFRCP and PFSQRT. 

PFACC, PFADD, PFMUL, PFSUB, and 
PFSUBR are used most frequently and are 
fairly self explanatory. PFACC accumulates 
the two double words of the destination 
operand and the source operand and 
stores the results in die low and high dou¬ 
ble words of die destination operand, re¬ 
spectively; see Figure 2. 

PFNACC and PFPNACC are Athlon spe¬ 
cific and similar to PFACC. PFNACC sub¬ 
tracts the two double words of the desti¬ 
nation operand and the source operand 
and stores the results in the low and high 
double words of the destination operand. 
PFPNACC subtracts the two lower double 
words of the destination operand and the 
source operand but accumulates the two 
upper double words of the operands and 


Instruction 

Description 

FEMMS 

Fast entry/exit of the MMX floating-point state. 

PSWAPD 

Reverse upper and lower double words of the source 
operand. 

PI2FD 

Packed floating-point to 32-bit integer conversion. 

PF2ID 

Packed 32-bit integer to floating-point conversion. 

PI2FW 

Packed 16-bit integer to floating-point conversion. 

PF2IW 

Packed floating-point to 16-bit integer conversion with 
sign extend. 

PFCMPEQ 

Packed floating-point comparison, equal to. 

PFCMPGE 

Packed floating-point comparison, greater than or equal to. 

PFCMPGT 

Packed floating-point comparison, greater than. 

PFMAX 

Packed floating-point maximum. 

PFMIN 

Packed floating-point minimum. 

PFRCP 

Packed floating-point reciprocal approximation. 

PFRCPIT1 

Packed floating-point reciprocal, first iteration step. 

PFRCPIT2 

Packed floating-point reciprocal/reciprocal square root, 
second iteration step. 

PFRSQRT 

Packed floating-point reciprocal square root approximation. 

PFRSQIT1 

Packed floating-point reciprocal square root, first iteration step. 

PFACC 

Packed floating-point accumulate. 

PFNACC 

Packed floating-point negative accumulate. 

PFPNACC 

Packed floating-point mixed positive-negative accumulate. 

PFADD 

Packed floating-point addition. 

PFMUL 

Packed floating-point multiplication. 

PFSUB 

Packed floating-point subtraction. 

PFSUBR 

Packed floating-point reverse subtraction. 

PAVGUSB 

Average of packed unsigned 8-bit values. 

PMULHRW 

Multiply packed signed 16-bit values with rounding and 
store high 16 bits. 

PREFETCH 

Prefetch processor cache line into LI data cache. 

PREFETCHW 

Prefetch processor cache line into LI data cache for writing. 


Table 1: 3DNow! instruction set. Instructions specific for Athlon CPU are printed 
in italics. 


stores the results in the low and high dou¬ 
ble words of the destination operand. 

PREFETCH and PREFETCHW load a 
cache line from L2 cache or main memo¬ 
ry to LI cache. PREFETCHW also marks 
the cache line as “modified” in anticipa¬ 
tion of subsequent data writes to the line. 
When used properly, these instaictions 
can significantly improve performance by 
eliminating data cache miss penalties. 

The complete 3DNow! instruction set 
reference is available from AMD; see 
3DNow! Technology Manual (Publication 
*21928, November 1998). 

Instruction Scheduling 

3DNow! instructions can be arranged in 
two groups: 

• PFADD, PFSUB, PFSUBR, PFACC, PF¬ 
NACC, PFPNACC, PFCMPx, PFMIN, PF- 
MAX, PI2FD, PF2ID, PI2FW, PF2IW, 
PFRCP, and PFRSQRT. 

•PFMUL, PFRCPIT1, PFRSQIT1, and 
PFRCPIT2. 


The arrangement reflects the internal ar¬ 
chitecture of AMD 3DNow!-capable CPUs, 
such as K6-2, K6-III, and Athlon (Figure 
3). The instructions from different groups 
utilize different shared execution units. Thus, 
two 3DNow! instructions can be paired and 
will execute simultaneously if they belong 
to different groups. For instance, PFMUL 
will pair with PFADD, giving the maximum 
throughput of four floating-point operations 
per cycle. Of course, general dependency 
and resource contention rules apply and 
limit the instructions’ pairing and simulta¬ 
neous execution; see Listing Three. The 
3DNow! instructions will pair well with in¬ 
teger or MMX instructions provided that 
there are no register dependencies and oth¬ 
er resource conflicts. 

3DNow! instructions are fully pipelined, 
take one cycle to execute, and have two- 
cycle latency (four-cycle latency on 
Athlon). Thus for optimal performance, 
the results of an instaiction being exe¬ 
cuted should not be referenced in die next 



Figure 1: Two packaged, single¬ 
precision, floating-point double words. 



Figure 2: FACC instruction. 
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cycle; see Listing Four. Listing Five is the 
properly scheduled code. 

Code Optimization 

The first step in code optimization is the 
original liigh-level code optimization. Port¬ 
ing to 3DNow! might require original al¬ 
gorithm modifications for better exploita¬ 
tion of instruction parallelism. 

Floating-point arithmetic is computa¬ 
tionally expensive, and should be used 
only when integer math does not provide 
the desired precision. If integer precision 
is satisfactory, the code should be ported 
to MMX, and MMX code optimization 
techniques must be used (see my article 
“MMX Code Optimization,” DDJ, Septem¬ 
ber 1999). 

The floating-point precision itself is an 
important limiting factor. 3DNow! tech¬ 
nology is applicable only when single- 
precision floating-point arithmetic suf¬ 
fice. For double (64-bit) or extended 
precision (80-bit) operands, there is no 
other way but to use x87 instructions. 

Typically, floating-point algorithms ex¬ 
hibit inherent parallelism and operate on 
fairly large data arrays or vectors. Such 
algorithms normally contain loops en¬ 
compassing patterns of arithmetic oper¬ 
ations that represent some operations on 


vectors. Therefore, it is possible to pro¬ 
cess numbers in pairs. For better in¬ 
struction, scheduling loop unrolling and 
aggressive instruction rearrangement may 
be necessary. 

In short, the process of code optimiza¬ 
tion/porting to 3DNow! is as follows: 

1. Determine the precision requirements 
of the algorithm. 

2. Write and optimize the code using high- 
level language. 

3. Identify the most performance con¬ 
suming code sections/loops. 

4. When targeting for K6-2/K6-III, straight¬ 
en all reverse vector operations. 

5. Unroll or split the selected loops on 
odd/even parts. 

6. Write straightforward 3DNow! code. 

7. Schedule and pair 3DNow!, MMX, and 
integer instructions to avoid pipeline 
stalls, register dependencies, and re¬ 
source contention. 

8. Strategically place PREFETCH instruc¬ 
tions to eliminate cache miss penalties. 

Reverse Vector 
Operation Straightening 

Many numerical algorithms involve vector 
or data array processing in forward and 
reverse direction. For example, Listing 


Register X Execution 
Pipeline 


Register Y Execution 
Pipeline 


Integer ALU 


Integer Shift 


Integer Multiply 
and Divide 


Integer Byte 
Operations 


Integer Special 
Registers 


Integer Segment 
Register Loads 


MMX ALU 
Add/Subtract, 
Compare 


MMX ALU 
Logical, Pack, 
Unpack 


3DNow! 
Add/Subtract, 
Compare, Integer 
Conversion, 

> Reciprocal and 
Reciprocal 
Square Root 
Table Lookup 


MMX and 
3DNow! 
Multiply, 
Reciprocal and 
Reciprocal 
Square Root 
Iteration 


MMX Shifter 


Integer ALU 


MMX ALU 
Add/Subtract, 
Compare 


MMX ALU 
Logical, Pack, 
Unpack 


Shared Register X and Y 
Resources 


Dedicated Register X 
Resources 


Dedicated Register Y 
Resources 


XRTPDS 

Motif widgets. 

And widgets....and widgets... 

If you’re looking for Motif 
widgets, you’ll find everything 
you need in the XRT PDS 
(Professional Developers Suite). 
2D and 3D charts and graphs, 
tables, dials and gauges, data 
input and validation, GUI 
extensions and enhancements... 
you’ll find it all in XRT. Try out 
a free eval of the most complete 
widget set anywhere, and start 
building Motif interfaces that 
really have it all! 


www.klgroup.com/all 



XRT/3d XRT/gear 

XRT/graph XRT/gauge 

XRT/table XRT/field 



KL Group Inc. 
1-800-663-4723 


KL Group Europe 
+31 (0)20 510 67 00 


Figure 3•' Register X unit and register Y unit resources. 
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Complete Your 
C++ Bookshelf 

From the Creator of C++, 
Bjarne Stroustrup... 


The 

legendary 
C++ best¬ 
seller is 
available 
in a hard¬ 
cover, 
collector’s 
version! 


The C++ 
Programming 
Language 


Bjarne Stroustrup 

Thr (rralor of (>» 


Includes all of the features of 
the third edition, plus significant 
new updates and two new 
appendixes on locales and 
standard library exception safety. 

0-201-70073-5 • 1040 pages 

C++ In-Depth Series 

Bjarne Stroustrup, Editor 


Hf| Accelerated C++ 


AntJrnv Koenig I 
Battvata E. Moo | 


Look for these C++ titles wherever 
fine technical books are sold. 

A Addison-Wesley 


Six(a) presents quite a challenge when be¬ 
ing ported to 3DNow!. The problem is that 
vector /* has to be processed in reverse or¬ 
der, and reversing the index is not enough 
since MOVD instruction loads data in 
straight order; see Listing SLx(b). 

The challenge is obvious because 
ci[j]*r[n- j-lj and a[j+lj*r[n- jl ex¬ 
pressions are calculated instead of 
a[j]*r[n-j] and afj+l]*r[n-j-l]. Unfor¬ 
tunately, the original MMX instruction set 
does not contain a PSHUFW instruction 
that allows rearranging words in an MMX 
register. Also, the original 3DNow! in¬ 
struction set lacks a useful PSWAPD in¬ 
struction, which swaps upper and lower 
double words of the source operand. 

Thus, when targeting for K6-2 or K6- 
III, you must either process the original 
array r in reverse order or insert additional 
MMX PUNPCK instructions for double 
word swapping. This requires the origi¬ 
nal algorithm modification in Listing Sev- 
en(a). Needless to say, such algorithm 
modification can be cumbersome. Also, 
the algorithm performance can be im¬ 
paired when the /-array components have 
to be swapped before or in the loop; see 
Listing Seven(b). However, the problem 
goes away with Athlon, and the code can 
be rewritten as in Listing Seven(c). The fi¬ 
nal value for beta is calculated after the 
loop using the PFACC instruction in List¬ 
ing Seven(d). 

Odd/Even Loop Split 

Another challenge comes from the fact 
that all 3DNow! instructions operate on 
pairs of floating-point numbers. Thus spe¬ 
cial handling is needed for cases when 
the number of array elements or loop it¬ 
erations is not even. 

For instance, in the beta calculation loop 
the problem arises when // is cxid. The last 
pair of MOVQ instructions will grab an ex¬ 
tra 32 bits of data from a- and /-arrays; see 
Listing Eight(a). Therefore, it makes sense 
to allocate and initialize with zeros an ad¬ 
ditional 4 bytes for each array to avoid 
memory access violation and an extra com¬ 
ponent in the sum. 

But this is not the end of troubles. In 
many cases, both arrays contain /// ele¬ 
ments, m>n. And it is in the nature of the 
algorithm to process a different number 
of elements in each iteration, as in Listing 
Hight(b). In this case, the beta calculation 
loop has to be split on odd and even part 
processing; see Listing Eight(c). The iter¬ 
ation counter ECX is initialized with //-1. 
If n is even, then the program branches 
to SKIPODD label after the last iteration; 
otherwise, the odd part is processed. 

This example won’t work correctly for 
n^l, thus the main loop must be unrolled 
for n=l and processed in an iterative man¬ 
ner for n=2 } 5,...m; see Listing Eight(d). 


PREFETCH Scheduling 

The last step in 3DNow! code optimiza¬ 
tion is PREFETCH instruction scheduling. 
Strategical placement of the PREFETCH in¬ 
structions can improve the algoritlims per¬ 
formance dramatically. 

The PREFETCH instruction is vector de- 
codable and takes two cycles. The num¬ 
ber of cycles required to fill 32-byte cache 
line depends on the cache and system- 
memory configuration. 

PREFETCHW instruction is identical to 
the PREFETCH instruction on K6-2/K6-III 
systems but is fully implemented on Atlilon. 

There are two major guidelines for the 
PREFETCH instructions scheduling: 

• The PREFETCH instruction should not 
be used in small loops. 

• Data loads should be scheduled away 
from the PREFETCH instruction. 

Small loops cannot take advantage of 
the PREFETCH instruction since data loads 
will occur soon after the PREFETCH in¬ 
struction. This results in pipeline stall be¬ 
cause the load operation has to wait until 
the data is available in LI cache. Also, two 
additional decode cycles can contribute 
considerable overhead to a short loop. 

Normally, the PREFETCH instruction is 
used as: 

PREFETCH [<index register>+32*<const>l 

The value of the <const> is determined 
by the number of cache lines processed 
in the loop. 

A 3DNow! Code Porting 
and Optimization Example 

The reverse vector operation straighten¬ 
ing, loop unrolling, and 3DNow! instruc¬ 
tion scheduling techniques are illustrated 
in a least-squares digital filter calculation 
routine available electronically; see “Re¬ 
source Center,” page 5. 

The routine solves a special system of 
linear equations using Toeplitz recursion 
(see Geophysical Signal Analysis, by E. 
Robinson and S. Treitel, Prentice-Hall, 
1980). This routine is also pan of the dig¬ 
ital image processing software I wrote for 
a PC-based ultrasound imager (see 
http://www.webzone.net/maxf/ultrason). 
It calculates FIR coefficients for ultra¬ 
sound pulse-shaping and image recon¬ 
struction. In general, this least-squares Fil¬ 
ter calculation routine can be used in any 
image-processing application. The filter 
coefficients are computed based on the 
input signal cl, the desired filter length m, 
and the desired output signal shape w. 
The file contains three routines: 

• ToeplitzO, the original nonoptimized 
routine representing a direct translation 
of math formulas. 
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• Toeplitz2( ), the modified routine with 
straightened reverse vector operations 
and two times unrolled main loop. 

• Toeplitz3( ), the 3DNow!-optimized ver¬ 
sion of Toeplitz2() , employing aggres¬ 
sive instruction scheduling and other 
MMX code optimization techniques. 

The filter coefficients produced by the 
original ToeplitzC) routine are slightly more 
accurate than those produced by 
Toeplitz3() due to the lack of precision 
in 3DNow! reciprocal calculation. 

The 3DNow! optimized routine cannot 
take advantage of PREFETCH instruction 
because of the small size of the loops. 

At one point in time, Toeplitz3( ) used 
odd/even loop splits, which were later 
replaced by array zero-initialization. The 
affected arrays are fairly small (128*4= 
512 bytes) and it takes less clock cycle 
to zero them than account for odd/even 
branching. 

In this FIR coefficient calculation ex¬ 
ample, the 3DNow!-optimized code runs 
4.5 times faster than the original C code 
(as measured on K6-2). This makes the 
porting to 3DNow! worth the trouble in 
this case. 

Performance Measurement 

It is possible to measure the 3DNow! code 
performance by measuring the time it 
takes to execute the code in a loop for a 
specified number of times. The Standard 
C clock( ) function is used. 

However, a more accurate performance 
data can be obtained when using the 
RDTSC instruction, which returns in 
EDXiEAX the number of cycles executed 
by the CPU since the processor reset. Thus 
to measure the code performance, you 
only have to write Listing Nine(a). CPUID 
is needed for serialization. It makes the 
CPU wait until all previous instructions 
have been executed. 

Listing Nine is neglecting RDTSC laten¬ 
cy and is less sensitive to task switching. 
If the task switch occurs, the number of 
counted cycles will be significantly larg¬ 
er. Thus it makes sense to run the per¬ 
formance measuring code several times 
and select the smallest EndTicks-StcirtTicks 
value. It will be the most accurate per¬ 
formance estimate since the instruction 
cache will be filled with the code in¬ 
structions, and task-switching artifacts are 
filtered; see Listing Nine(b). 

If it is necessary to flush the data cache 
for the performance measurement, it is 
sufficient to use the memset( ) function to 
fill some array the size of the data cache 
(32 KB for K6-2). There is no need for 
\VBINVD privileged instruction. 

For more demanding uses, there Ls a fan¬ 
cy performance-measuring sample called 
“OpTimer” packaged with AMD SDK 


(http://www.amd.com/swdev/swdev.html). 
It provides nice GUI interface and contin¬ 
ues performance-measuring capability. 

Lastly, when optimizing code it is rec¬ 
ommended to do one change at a time 
and run the performance measuring. 
When several changes are made to the 
code, they might compensate each other, 
making it harder to find winning combi¬ 
nation. 

Conclusion 

3DNow! technology is a powerful tool for 
fast floating-point number crunching, and 
it can be advantageous for a wide variety 
of applications ranging from 3D games to 
medical imaging. 

The potential 300-400 percent per¬ 
formance gain makes the idea of port¬ 


ing existing x87 applications to 3DNow! 
attractive. At the same time, 3DNow! code 
porting and optimization can be a te¬ 
dious and time-consuming process. Luck¬ 
ily, compilers are starting to provide sup¬ 
port for 3DNow! teclinology. For instance, 
Metrowerks CodeWarrior C++ compiler 
utilizes vectorization techniques to gen¬ 
erate 3DNow! instructions in place of x87 
commands. 

The 3DNow! SDK (http://www.amd 
.com/swdev/swdev.html) is freely avail¬ 
able if you want to jumpstart in 3DNow! 
technology and bring applications to a 
new level of performance. 


DDJ 

(Listings begin on page 46.) 
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listing One 

; compute y/v and x/w 


KOVD 

PFRCP 

PUNPCKLDQ 

PFRCPIT1 

KOVQ 

PFRCPIT2 

PFMUL 


HMO.mem ; 0 
HM1.HM0 : 1/w 
MK0.MK0 : v 
MK0.MM1 ; l/v 
MM2.mem : y 
KK0.MM1 ; l/v 
KM2.KM0 : y/v 


listing Two 

KOVD MK 
PFRSQKT MM 
KOVQ MM 
PUNPCKLDQ MM 
PFMUL MM 
PFRSQIT1 KM 
PFRCPIT2 MM 
PFMUL MM 


l/v (14-bit approximation) 
v 

l/v (intermediate) 
x 

l/v (24-bit precision) 
x/v 


0 

1/eqrt (v) 


l/sqrt(v) (15-bit approximation) 


sort(w) A 2 | sort(w) A 2 
1/aqrt(v) ! l/sqrt(v) 
l/sqrt(v) ! l/sqrt (v) 
sqrt(v) } sqrt(v) 


(intermediate) 
(24-bit precision) 


MK0.KK0 

beta.MH0 


; a[n]*r[c+n] + a[n+l]*r[c+n+l] 
; Oops! Extra a[n+l]*r[c+n+l] 


M 

float a[m]. r[a]; // m is some constant 

// Initialize arrays a and r 

for ( n = 1; n < a; n++ ) // main loop 

beta = 0; 

for ( j «* 0: j < n: j++ ) 

beta += a[j]*r[c + j]; // c is some constant 

// Do something else 


; Compute beta 


listing Three 


listing Four 


Listing Five 


Listing Six 

W 


this instruction pair vill execute 
in the same clock cycle 
this instruction pair won't execute 
simultaneously due to register dependency 


1-cycle stall occurs here because the result 
in MM1 vill be ready in the next cycle 


1-cycle stall occurs here 

no stall, the result in MM1 is ready 


for ( j » 0: j < n; j++ ) 
beta += a[j]*r[n - j); 


; eax = j. ebx = n-j-1 
KOVQ HM0.a[EAX*4] 

KOVQ MMl.r[HBX*4] 

PFMUL MH0.MM1 


listing Seven 


a(j] ! a[j+ll 
r(n-j-1) ! r[n-j] 
s[j]*r[n-j-1] | a[j+l]*r[n-j] 


// Calculate r in reverse order (if possible) or swap the array elements 


KOVQ KH0.a[BAX] 

MOVQ MMl.r [EAX] 

PFMUL MM0.MM1 

PFADD MM2.MM3 

ADD EAX. 8 

SUB BCX.2 

JG M 

JNE SKIPODD 

: odd part processing 
MOVD MM3.a[EAX] 

MOVD MMl.r[EAX] 

PFMUL MM0.MM1 

PFADD MM2.MM0 

SKIPODD: 

PFACC MM2 .MM2 

KOVD beta.MM2 


a[j] 

r[c+j) 

a[n]*r[c+j] 

betaO 


a[j+l] 

r[c+j+l] 

a[j+l]*r[c+j+l] 

betel 


end of even part 


a[n-l] 

r[c+n-lj 

a[n-l]*r[c+n-l] 

beta0 


1 beta0 + betal 


(d) 

// Unroll for n = 1 
beta = a[0]*r[c]; 

//Do something else for n - 1 

// Process for n = 2, 3,...m 
for ( n = 2; n < n; n ++ ) // main loop 

( 

// 3DNov! optimized loop for beta calculation 
__asm { 

} 

//Do something else 


Listing Nine 

(o) 


for ( j a 0; j < n; j++ ) 

beta +s* a[j]*r[c + j]: 


// beta calculation loop 
// c is some constant 


,_int64 StartTicks, EndTicks: 
asm ( 

CPUID 

RDTSC 

MOV DWORD PTR StartTicks.EAX 
MOV DWORD PTR StartTicks[4].EDX 
// Code which performance is measured 

CPUID 

RDTSC 

MOV DWORD PTR EndTicks.SAX 

MOV DWORD PTR EndTicks[4].EDX 

// EndTicks - StartTicks = Running Time in CPU cycles 


for ( j » 0; j < n: j++ ) 

float c ° r[n - j]: // swap(r[j], r[n-j]: 
r[n - j] = r[j]; 

} r[j) « c: 


KOVQ 

PSWAPD 

PFKUL 

KM0.a[EAX*4] 
MMl.r[BBX*4] 
MK0.HM1 

a[j] 
r[n-j] 
a[j]*r[n-j] 

a[j+l] 
r[n-j-1] 
a[j+l]*r[n-j-l] 

(d) 

PFACC 

MOVD 

KM0.KM0 

beta,MM0 

a[j]*r[n-j] 

a[j+l]*r[n-j-l] 

Listing Eight 



w 

: n-th 
KOVQ 
MOVQ 
PFMUL 

iteration 

MK0,a[EAX*4] 
MMl.r[EBX*4] 
MK0.KM1 

a[n] 
r[c+nj 
a [n] *r (c+nj 

a[n+l] 

r[c+n+l] 

a[n , *-l]*r[c+n+l3 


_int64 StartTicks. EndTicks, Ticks = 0x7FFFFFFFFFFFFFFF; 

for ( int i = 0: i < 10: i++ ) 

[ 

// Flush the data cache if necessary 
// memset(data, 0. sizeof.data.cache); 

_asm ( 

CPUID 

RDTSC 

MOV DWORD PTR StartTicks.EAX 

MOV DWORD PTR StartTicks[4].EDX 

// Code which performance is measured 

CPUID 

RDTSC 

MOV DWORD PTR EndTicks.EAX 

MOV DWORD PTR EndTicks[4].EDX 

if ( EndTicks - StartTicks < Ticks ) 

Ticks = EndTicks - StartTicks: 


: after the loop 
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Augural Image 
Zooming 


Enlarge digital images 
rapidly and crisply 

Wm. Douglas Withers 

F igure 1 is an image represented as a 
192x300 matrix of pixels, each with a 
specified color value. Figure 2 is a 
smaller image, represented as a 96x150 
matrix of pixels, thus containing only one- 
fourth the quantity of data of Figure 1. Fig¬ 
ure 3 is the same 96x150 image as Figure 
2, but covering the same area as Figure 1, 
so that each pixel has four times the area 
of the pixels in Figure 1. Even though Fig¬ 
ure 3 is coarser than Figure 1 (that is, of 
lower resolution rather than smaller), it is 
obvious that they represent the same scene. 

Figure 3 was derived from Figure 1. 
Each coarse pixel of Figure 3 corresponds 
to a 2x2 group of four fine pixels from 
Figure 1; and the color value (having three 
components red, green, and blue) of the 
coarse pixel is the average of the color val¬ 
ues of the four fine pixels. The coarse im¬ 
age, Figure 3, created by shrinking the fine 
image, Figure 1, is identical up to round¬ 
ing error with an image of the same reso¬ 
lution created directly from the given scene. 

The derivation of a finer image from 
a coarser one is referred to as “image 


Els is a member of the Depatl merit of Math¬ 
ematics at the US. Naval Academy and a 
research scientist with Pegasus Imaging. 
He can be contacted at wdw@usna.edu. 
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zooming.” Unlike shrinking, zooming in 
an exact sense is theoretically impossi¬ 
ble, because many different finer images 
correspond to a single coarser image. So 
in zooming an image, you don’t expect 
to reproduce the finer image exactly— 
rather you seek to choose the most plau¬ 
sible of all the possible finer images cor¬ 
responding to the coarser. 



Image zooming has a variety of appli¬ 
cations. Multitudes of images travel dai¬ 
ly over the Internet. Due to the limited 
capacity of the transmission channel rel¬ 
ative to the quantity of data in an image, 
transmission of a single image often re¬ 
quires seconds or minutes. This delay can 
be alleviated by sending images in a pro¬ 
gressive format: a low-resolution version 
of the image to begin with, followed by 
additional data providing a gradual in¬ 
crease in resolution. The recipient can 
then get an early impression of an image 
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and interrupt the transmission if desired. 
Skillful zooming improves the appear¬ 
ance of the image while it has been only 
partially transmitted. You might zoom an 
image to move it from one device to an¬ 
other with higher resolution. A comput¬ 
er monitor may display an image at a res¬ 
olution of 72 pixels per inch, w r hile a 
printer may provide resolution of 300 pix¬ 
els per inch. Printing an image displayed 
on the monitor entails either printing the 
image at a smaller size or increasing the 
resolution. 

In the U.S., digital television (DTV) is 
coming into real use. The new format pro¬ 
vides resolution more than double the old 
NTSC. However, much programming has 
been recorded on NTSC-compatible me¬ 
dia, such as VHS videotape. Viewing such 
media on a high-resolution television en¬ 
tails either using only a small portion of 
the screen or zooming the video signal. 

Various image-zooming approaches are 
already in use. The most primitive, but 
also one of the most popular, is resam¬ 
pling or pixel replication. Resampling con¬ 
sists of simply repeating the pixel values 
of the image as necessary to achieve the 
desired size. Figure 3 could be zoomed 
by resampling to the same resolution as 
Figure 1, but with no change whatsoever 
in appearance. The resampling method is 
fast, but leaves much to be desired in qual¬ 
ity. Figure 3 shows objectionable features 
(jaggies) along sharp edges, such as the 
edge of the model’s dress, or the edges 
between her right shoulder or right cheek 
and the background. Smooth areas such 
as the dimple in her throat or the right 
side of her forehead show less prominent 
artifacts. 
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(continued from page 48) 

Figure 4 is a slightly more sophisti¬ 
cated approach, produced by linearly in¬ 
terpolating to determine the new pixel 
values. This eliminates most of the ob¬ 
jectionable features seen in smooth re¬ 
gions of Figure 3. Moreover, jaggies on 
sharp edges are much alleviated. How¬ 
ever, edges and other regions of detail 
show blurring. 

In this article, I present a fundamental¬ 
ly new method for zooming images, which 
I call the “augural method.” My goal in 
developing the augural method was to 
zoom images with a minimum of com¬ 
putation, while keeping smooth regions 
smooth and sharp edges sharp. The 
method described here serves to double 
the scale of an image; the same principles 


have been applied to zoom an image to 
any desired size. 

Principles of the Augural Method 

For starters, I assume that the coarse im¬ 
age to be zoomed is a digital photograph 
of a real scene; for example, Figure 1 
depicts a woman wearing a black dress 
in the depicted environment. The tran¬ 
sition from real scene to digital image 
may have comprised several steps in¬ 
volving cameras and scanners; but I as¬ 
sume that the ultimate effect is equiva¬ 
lent to laying a rectangular grid in front 
of the scene and filling each grid cell 
with the average color value of the cor¬ 
responding region of the scene. Each 
grid cell then becomes one pixel of the 
image. A finer image of the same scene 


Dr. Dobb’s Journal, August 2000 


can be created simply by using a grid 
with smaller rectangles. 

The augural method is thus inappro¬ 
priate for certain types of images: syn¬ 
thesized images containing features such 
as aliased edges, which would not appear 
in a digital photograph of a real scene; or 
dithered images, where the pixel values 
no longer represent average color values 
of the corresponding grid cells. The 
method is applicable, however, to syn¬ 
thetic images (such as ray-traced images) 
created using an underlying ideal model. 

Figure 5 is a magnified portion of an 
ideal scene, together with pixelizations 
at various resolutions. Region I shows 
the ideal scene. Region F shows a fine 
pixelization, while Region CR shows a 
coarse pixelization at half the resolution 
of Region F, each pixel in Region CR cov¬ 
ering the same area as four pixels in Re¬ 
gion F. Region C represents an intermedi¬ 
ate stage whose pixels cover the same area 
as just two pixels from Region F. In Re¬ 
gions F, C, and CR, each pixel value equals 
the average value of the underlying ideal 
image over the corresponding rectangle. 
But each pixel value in Region C can also 
be calculated as the average of the corre¬ 
sponding pair of pixel values from Region 
F. Similarly, each pixel value in Region CR 
equals the average of the corresponding 
pair of pixel values in Region C. 

The goal of zooming is to derive a good 
approximation to the fine pixelization in 
Region F from a coarse pixelization like 
that in Region CR. I chose to consider the 
simpler problem of producing the inter¬ 
mediate pixelization in Region C. Essen¬ 
tially, the same process can then be ap¬ 
plied to the intermediate pixelization (with 



Figure 1: 192 x300 image. 


http://www. ddj. com 



ompuers 

• PGHPF® Workstation 
F77/F90/HPF compilers and tools 
for multi-CPU Linux systems 

• Single-CPU performance up to 
30% faster than g77 

• Automatic loop parallelization 
using a simple command-line 
switch 

• Full native OpenMP 
user-directed parallelization 

• IBM/DEC/CRAY/F95 extensions 

• Pll/PIII-specific optimizations 

• From $499, academic and volume 
discounts available 

• Fully functional 15-day free trial 
version at www.poroup.com 

The Portland Group 

www.pgroup.com (503) 682-2806 fax: (503) 682-2637 e-mail: sales@pgroup.com 

PGHPFis a registered trademark of The Portland Group. Inc. Other brands and names are the property of their respective owners. 



50 













a 90 degree change in orientation) to pro¬ 
duce the fine pixelization. 

The essence of the augural method is to 
start with a coarse pixelization, hypothesize 
a model for the underlying ideal structure 
in each neighborhood of the real scene, an¬ 
alyze die coarse pixel values to refine die 
details of the model, and use diis model to 
calculate die corresponding pixel values in 
the fine image. Deriving a model for the 
underlying image structure is a deep, sub¬ 
tle problem without a complete solution. 
The augural method, by compromises and 
makeshifts, makes a crude judgment diat 
nonetheless proves quite useful. 

Images are two dimensional. The first 
compromise of the augural method is to 
operate in only one dimension at a time. 
The resolution of the image is doubled in 
two steps; first die vertical resolution is dou¬ 
bled (Region CR to Region O, and then 
the horizontal (Region C to Region F). 
Moreover, when doubling the vertical (or 
horizontal) resolution, each column (or 
row) of the image is considered in isola¬ 
tion, and doubled in resolution. (The un¬ 
derlying image-structure model, however, 
is considered in two dimensions.) Thus, 
each coarse pixel corresponds to a pair of 
fine pixels. The following discussion is 
couched in terms of doubling the length 
of a row; but doubling a column is es¬ 
sentially the same except for orientation. 

I describe the method as applied to 
8-bit gray-scale images, each pixel value 
a number in the range 0 to 255. Color im¬ 
ages can be zoomed quite satisfactorily by 
zooming the red, green, and blue color 
planes separately. Other levels of preci¬ 
sion can be handled by straightforward 
modifications. 



Figure 2:96x150 image. 
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I denote the coarse pixel values in a row 
from left to right by C[0], C[ 1],..., C[w- 1], 
where w is the width of the coarse row. I 
must calculate estimated fine pixel values 
H0],H1],...,H2 m>- 1] (twice as many fine 
pixels as coarse pixels in a row). The coarse 
pixel with value C[n] covers die same re¬ 
gion of the image as the two fine pixels 
with values F[2n ] and F[2n+ 1]. As already 
noted, Cln] equals the average of F[2n\ and 
F[2n+\\. C[nHF[2n]+F[2n+\])/2. 

Let D[n]=F[2n+X\-F[2n]\ then F[2n] 
and F[2n+1] can be calculated from C[n] 
and Din]: Fl2nhC[n]-Dln]/2, F[ 2//+l]= 
C[n]+Dln]/2. 

The problem now is how to determine 
the value of D[n] corresponding to a par¬ 
ticular Cln]. Splitting the coarse pixel with 
value C[n] (henceforth called the “home” 


pixel) entails predicting D[n] and then us¬ 
ing it to find F[2n] and F[2n+1]. I proceed 
across the row from left to right, so when 
splitting the home pixel with value Cln], 
not only are all coarse pixel values of the 
row available, but also available are the 
fine pixel values from F [0] to F[2n-\\. To 
predict the value of D[n], I utilize the three 
values Fl2n-\], Cln], and Cln+ 1] (and 
eventually F[2n-2]). 

I imposed some abstract mathematical 
conditions upon the zooming process. The 
first condition is variation preservation. 
The variation of the row is the total 
amount of fluctuation up and down as 
one travels across the row. The variation 
of the original coarse row is V co . xrsc = 
| CIW-C10] | +1 Cl2]-Cll] |+...+ | Clw- 1]- 
C[w-2] |; the variation of the calculated 
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Figure 3:96x150 image, but covering 
area as Figure 1. 


fine row is | F[l)-F[0] | +1 F[2]-F[\] | + 
... +1 F[2w-]-F[2w-2] |. 

It is always true that ^>1^0.,^.; vari¬ 
ation preservation is the additional con¬ 
dition that Vf ine <^coarse- 1 imposed this 
condition as a preventative against zoom¬ 
ing artifacts: the introduction of detail into 
areas such as smooth regions, where the 
eye expects none. This seems visually 
more disturbing than the absence of de¬ 
tail where expected. Sophisticated zoom¬ 
ing tools such as fractals or wavelets some¬ 
times generate such artifacts, which as a 
aile entail a variation increase. Variation 
preservation also eliminates the possibil¬ 
ity of pixel-value overflow or underflow. 

You can show that variation is preserved 
if for each D[n] the resulting F[2n\ and 
F[2n+l] satisfy: | F\2n\-F[2n-\] | +1 F[2n+1]~ 


F[2n] | +1 C[n+1]-F[2n+1] |< | (M-F[2n-\] | 
+ \C[n+l\-C[n]\. 

The second condition is that the zoom¬ 
ing process be invariant when all pixel 
values are modified by addition of or mul¬ 
tiplication by a constant. The rationale is 
that adding a constant to all pixel values 
has an effect akin to twiddling the bright¬ 
ness knob on the computer monitor, and 
multiplying all pixel values by a constant 
is like twiddling the contrast knob. Both 
transformations change the colors of ob¬ 
jects in the image without affecting struc¬ 
tural features. So, if you define a new set 
C T of coarse pixel values by the transfor¬ 
mation C 7 [nhpC[n]+q, the corresponding 
fine pixel values F r obtained by zooming 
C T should be related to the original fine 
pixel values Fby: F 7 [nhpFln]+q. The trans¬ 


formed fine-pixel differences D T then sat¬ 
isfy: DtbihF^n+D-Fj&nMpFQn+W+q)- 
(pF[2n]+q)=pD[nl 

This condition lets me set p and q to any 
convenient values for die purpose of split¬ 
ting die home pixel widi value Cln]; I can 
use standard settings for “brightness” and 
“contrast” of the image, which will simpli¬ 
fy my task. I choose to let: p=l/(C[n+l}- 
F[2n-1]) and q=-F[2nl]/(.C[n+l]-F[2n--lJ) 1 
the case C[n+l]=F[2n-l] being moot be¬ 
cause variation preservadon then requires 
diat D[//]=0. Then: /y[2/M]=0, C-j{n]=(C[n]- 
F[2n-l])/(C[n+l]-F\2n-l]), C 7 |//+l]=l. The 
fine-pixel difference D[n] can lie calculated 
as: Din] =D T [n]/p<C[n+l]-F[2n-l])D T [nl 

The prediction of D[n] from the values 
of F[2n- 1], C[n], and C[)i+ 1] now reduces 
to a single input variable, die “augury”: A= 
C T {n]=(C[n\-F[2n-\\)/(C[n+\\-F[2n-\]), 
and a single output variable, the “decliv¬ 
ity”: D=D r [nhD[nV(C[n+l]-F[2n-l]). 

The declivity will be calculated as a cer¬ 
tain function G, the “geminator,” of the 
augury: D=<X4). 

Premises and 

Consequences of Geminators 

A geminator arises from an assumption 
(which I call a “scenario”) concerning the 
type of structure found in the image. Fig¬ 
ure 6 is part of an image with certain fea¬ 
tures of particular interest highlighted. Each 
highlighted region represents two coarse 
pixels (having values C[n] and C[n+ 1]) 
with an adjacent fine pixel (having value 
F[2n-\]). The middle (home) pixel with 
value C[)i] is to be split into two fine pix¬ 
els with values F[2n] and F[2n+1\. Recall 
that the only information available is the 
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average value over the rectangular region 
that is each pixel, as in Figure 7. 

The image may contain structures quite 
complex at the given resolution level (such 
as the yellow region in Figure 6). Faith¬ 
fully zooming these regions is most like¬ 
ly impossible, and I did not try. Rather, I 
chose to consider simple features such as 
smooth areas (red) and sharp, straight 
edges at various orientations to the pixel 
grid (red, green, and blue). These features 
are simple enough to be feasible of ana¬ 
lysis, occur frequently in most images, and 
are visually important. 

Consider first the blue-shaded region 
in Figure 6, an example of a sharp, straight 
edge passing through the home pixel per¬ 
pendicular, or almost so, to the pixel row. 
I call this the “perpendicular-edge” sce¬ 
nario. In this scenario, the declivity can 
be calculated as a function of the position 
of the edge within the home pixel. The 
augury’ can also be calculated as a func¬ 
tion of this position; in fact, the augury 
equals the distance between the edge and 
the left boundary of die home pixel. Thus, 
the declivity can be calculated as a func¬ 
tion of the augury, yielding the gemina- 
tor for the perpendicular-edge scenario. 

The result is the function G P (A)=2A for 
0<L4<0.5; G P (A)=2-2A for 0.5<A<1. Fig¬ 
ure 8 is the graph of G P (in blue), and 
also its peak value, which occurs when 
the perpendicular edge exactly bisects die 
home pixel. 

Values of A less dian 0 or greater than 1 
do not occur in die perpendicular case; how¬ 
ever, for such values of A , variation preser¬ 
vation requires that G P (A)=0. In fact, the 
variation-preservation condition translates 



Figure 4: Image zoomed by linear 
interpolation. 
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into a straightforward condidon on die gem- 
inator G for any scenario: 0<G(A)<G P (A)\ 
in other words, the graph of G is con¬ 
strained to lie within the variation- 
preserving zone shown as light gray in Fig¬ 
ure 8. This zone takes die single value 0 for 
values of A less than 0 or greater than 1. 

Figure 10 is the result of zooming us¬ 
ing Gp. For comparison, Figure 9 shows 
zooming by resampling. Repeated zoom¬ 
ing exaggerates the special characteristics 
of a given zoomer. I therefore zoomed a 
small portion of the image (bounded by 
the blue rectangle) mice to facilitate de¬ 
tailed comparison. 

Figure 10 cannot be considered a suc¬ 
cess, though it does have some interest¬ 
ing features. Vertical and horizontal edges 
indeed retain sharpness. Smooth areas 
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break up into patches of constant color. 
And diagonal edges acquire a stair-step 
appearance. Repeated zooming accentu¬ 
ates all of these effects. The failure of this 
zoomer, derived from a sharp-edge sce¬ 
nario, to handle smooth areas properly is 
unsurprising. However, its performance 
on diagonal edges is disappointing. 

Consider next a smooth area of the 
image (such as the model’s cheek, red 
in Figure 6), which I call the “smooth” 
scenario. You can calculate the gemina- 
tor in the smooth scenario to be 
(7 5 G4)=G4+l)/5, constrained to stay with¬ 
in the variation-preserving zone (red in 
Figure 8). Figure 8 also indicates the spe¬ 
cial case of a fixed rate of brightness 
change, with resulting augury A=5/l and 
resulting declivity D=2/7. 
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Figure 5: An “ideal” image (I) 
together with a “fine”pixelization (F), 
a “coarse”pixelization (C) with pixels 
twice the area of (F), and a “coarser” 
pixelization (CR) with pixels twice the 
area of (C). 

The “gentle-edge” scenario supposes a 
sharp, straight edge just slightly inclined 
to the pixel row (also red in Figure 6). 
Though visually wholly unlike the smooth 
scenario, this scenario yields exactly the 
same geminator G s . 

Figure 11 is the result of zooming us¬ 
ing G s . Exactly as expected, it performs 
well in smooth areas, but on edges shows 
blurring similar to linear interpolation. 

Because neither the perpendicular-edge 
scenario nor the smooth scenario yielded 
satisfactory results on diagonal edges, I 
next investigated the “diagonal-edge” sce¬ 
nario, wherein a sharp edge runs diago¬ 
nally through die home pixel (green in Fig¬ 
ure 6). For the First time I needed to take 
aspect ratio into account: Splitting a square 
pixel into two narrow rectangular halves 
requires a different geminator from split¬ 
ting a narrow rectangular pixel into two 
square halves. In both cases, I determined 
the geminator by calculating augury and 
declivity from the areas of various trape¬ 
zoids and triangles, and then solving for 
the declivity in terms of the augury. 

The case of splitting a narrow rectan¬ 
gular pixel yields the geminator 
G d (A)=4A -44 2 -0.25 for 0.25<zl<0.75, 
G D (A)=G P (A) elsewhere. The case of 
splitting a square pixel into two narrow 
rectangular halves yields a different gem¬ 
inator H d . I omit here the formula for H D 
because of its complexity, but Figure 8 
shows the graphs of both G D and H D . 
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Figutv 6: Colored bars indicate various 
image structures to be analyzed. Dark 
lines show pixel boundaries. Pixel 
splitting is proceeding from left to right 
within each roiv, although some rows 
are furlher along. 

Figure 8 indicates also the peak values 
for G d and H D (both occurring when the 
diagonal edge bisects the home pixel), 
as well as other critical values for both 
functions. 

Figure 12 is the result of zooming us¬ 
ing G d and H d . This zoomer not only 


Figure 7: This is a pixelized 
version of Figu re 6. Tide image 
structure within each 
coarse pixel to be split must he 
analyzed using only this 
information. 

performs well on diagonal edges, but 
by good fortune also yields acceptable 
results on perpendicular edges (unlike 
G P , which performed strangely on di¬ 
agonal edges). In smooth areas, G D and 
H d yield a faceted appearance similar 
to G P . 


Figure 8: Graphs of gem inators derived from various image-stmcture scenarios. 
Voe variation-preserving zone is shown in light gray. Several critical values of 
the gem inators are also shown (shaded boxes). 


Dr. Dobb’sJournal August 2000 


Augury 


> 

1 

Q 

1 . 0 - 


http://www. ddj. com 
























































































































































































































Windows DNA & The New Economy 


Forbes nasdaq (j§$ AMEX (§) Quote.com 

CORILLIAN 


CapitalStream 


Q^jcharts' 


FuturesOnline.com 


SunTrust 


swS 


®Marketty/atch 

cbs.marketwatch.com 


MONTE 
DEI PASCHI 
DI SIENA 

BANCA DAL 1472 


raw 

A1 


Bolsa de Valencia 


PowerTrack. 

(^3bank. 



Ohio Savings 

BANK 


VirtualBank 


Microsoft 1 Windows 1 DNA is the platform of choice in the New Economy. 

Today’s financial services are more software-intensive than ever. So when 
these companies needed an advanced software platform that would enable 
them to rapidly adapt to market changes, it made perfect sense to choose 
Windows DNA. To learn how Windows DNA can help you build tomorrow’s 
applications today, visit microsoft.com/dna 
Where do you want to go today? 


Microsoft 


' 2000 Mcrwoft Corporation. AH right* reserved. Microsoft. Windows and Where do you *jrif tn go today? are either registered trademarks or trademarks of Microsoft Corporation in the Unitod Statoa ond/or other countries. The names of actual companies and products mentioned herein may bo the trademarks of their respacthe owners. 

















(continued from page 54) 

Clearly what is needed is a zoomer that 
combines the performance of G D and H D 
on edges and the performance of G s on 
smooth areas. The elements F[2n-l], C[n], 
and C[;z+1] of the augury, are simply not 
sufficient information to distinguish between 
the smooth and diagonal-edge scenarios. I 
thus resorted to using the value of F[2n-2] 
to decide between these two scenarios 
when splitting a given pixel. 

The diagonal-edge scenario supposes 
that a sharp edge is traveling diagonally 
across the home pixel. In such a case, 
D[n-l] (the difference F[2n-l]-F[2n-2]) 
should be close to zero compared to the 
difference Cln+lKFErc-l]. On the other 
hand, in the smooth scenario, the differ¬ 
ence F[2n-\]-F[2n-2] should be about 
2/7 of the difference C[n+1]-F[2n-1]. 

The criterion I used is this: the diagonal- 
edge geminator G D or H D is used if: | D[n- 
l]\<0.Q5\C[n+l]-F[2n-l]\; the smooth 
geminator G s is used otherwise. 

Figure 13 is the result of zooming us¬ 
ing a G d and H D in combination with G s . 
This combination zoomer keeps smooth 
areas smooth and sharp edges sharp. 

Zooming with Integer Arithmetic 

Most image formats specify pixel values 
as integers, and for better speed and wider 
applicability I wanted a zooming algorithm 
that operates entirely in integer arithmetic. 
To this end, I made several adaptations to 
the hitherto-described method. 

First, recall: C[n]=(F[2n]+F[2n+l])/2, 
D[n]=F[2n+l] -F[2n]. In integer arithmetic, 



Figure 9: Image zoomed by 
resampling. 
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division by 2 in the calculation of C[n] en¬ 
tails losing the lowest precision bit. How¬ 
ever, you can still recover F[2n] and F[2n+1] 
from C[n] and Din] by: F[2n]=C[n}- 
GDfo]»l), H2»+l]-C[»]+(CD[w]+l)»l). 
Here, I shift right by one bit rather than di¬ 
vide by two so that the result is rounded 
down rather than towards zero. 

One advantage of distilling the three 
values F[2n-1], C[n], and C[n+ 1] down 
to the single value A is that you can use 
a lookup table to evaluate the geminator, 
a function of a single variable, whereas a 
lookup table with three input variables 
might be completely infeasible. Thus, the 
computational complexity of the gemina¬ 
tor is of no concern. 

However, consider die range of possible 
values of the augury: A=(C[n]-F[2n-\])/ 
(C[n+l]-F[2n-l]). With pixel values rang¬ 
ing from 0 to 255, the augury A ranges in 
magnitude from 1/255 to 255, even ex¬ 
cluding zero and infinite values. To reduce 
lookup table size needed, I manipulated 
augury and declivity on a logaridimic scale. 
Tliis also eliminates multiplication and di¬ 
vision operations from the algorithm. 

In integer arithmetic, the augury is rep¬ 
resented by the variable LgA, calculated 
as: LgA=Lg(C[n]-F[2n-l])-LgE, where 
LgE=Lg(C[n+l]-F[2n-l]). The function 
Lg() is a modified logarithm, calculated 
by means of a lookup table. Modifications 
are necessary for three purposes: to han¬ 
dle zero arguments, handle negative ar¬ 
guments, and represent the output as an 
unsigned char. 



Figure 10: Image zoomed by the 
augural method with perpendicular- 
edge scenario. 


To handle zero arguments, I exploited 
the truncation error in calculating C[n] (or 
C[n+ 1]) as an average of two fine pixel 
values. This error causes the value to be 
underrepresented by 0.5 about half the 
time, underrepresented by 0.25 on aver¬ 
age. The argument to Ig(), being always 
a difference between a coarse and a fine 
pixel value, is also underrepresented by 
0.25 on average. To compensate for this, 
Lg() adds 0.25 before taking the logarithm, 
thus eliminating the occasion for taking 
the logarithm of 0. 

To handle negative arguments, I adopt¬ 
ed the convention of representing the log¬ 
arithm of a positive number by the loga¬ 
rithm rounded to the nearest even integer 
and representing the logarithm of a neg¬ 
ative number by the logarithm of the ab¬ 
solute value, rounded to the nearest odd 
integer—exploiting the fact that the par¬ 
ity of a difference of integers is even if 
and only if the two arguments have the 
same parity, just as the sign of a quotient 
of real numbers is positive if and only if 
the two arguments have the same sign. 

Finally, I normalized the function Lg() 
by subtracting a constant so that Lg( 0)=0, 
and hence all values of Lg() are non¬ 
negative. This constant cancels out when 
the two outputs from Lg() are subtracted 
in the calculation of LgA. 

Thus, the actual formula for Lg(t ) is: 
ZgGHoga | t+0.25 1 - log/, 0.25, rounded to 
the nearest odd integer for negative t and 
rounded to the nearest even integer other¬ 
wise. Laiger values for the logarithmic base 
B yield more compact look-up tables at 



Figure 11: Image zoomed by the 
augural method with smooth scenario. 
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(continued from page 56) 
the expense of precision of calculation. I 
recommend the value £=1.027653151, 
which allows Lg and the other lookup ta¬ 
bles to be byte valued, while keeping as 
much precision as possible, so that 
Zg(255)=254 and Ig(- 255)=253. 



Figure 12: Image zoomed by the 
augural method with diagonal-edge 
scenario. 



Figure 13: Image zoomed by the 
augural method with a combination of 
smooth and diagonal-edge scenarios. 
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The declivity D is represented on a log¬ 
arithmic scale by the variable LgDelta , re¬ 
lated to D by the formula: LgDelta=\og B 
D- logfl 0.25, rounded to the nearest even 
integer for positive values of D and to the 
nearest odd integer for negative values. 
The fine-pixel differences D[n] and Din- 1] 
are represented on a logarithmic scale by 
the variable IgD , related to E[n] (or Din- 1] 
as occasion demands) by: LgD=\og B 
Din}- log/* 0.25-log B 0.05, likewise round¬ 
ed to an even or odd integer according to 
the sign of Din]. These various versions 
of the logarithmic scale allow LgD to be 
calculated as: LgD=LgDelta+LgE, while the 
criterion | Din- 1] | <0.051 Cln+1]-F[2n-1] | 
for choosing the diagonal-edge versus the 
smooth scenario translates into simply: 
LgD<LgE. 

The actual fine-pixel difference Din] 
must be recovered from the logarithmic 
LgD in order to calculate the fine pixel 
values; this is done by the modified ex¬ 
ponential function Xp() (also calculated 
by lookup table), given by: Xp(LgD) = 
C(0.25)(0.05 )B^ D , rounded to the nearest 
integer, negatively valued for odd LgD , 
and positively valued otherwise. 

Finally, the geminators G D , H D , and G s 
must be adapted to the appropriate loga¬ 
rithmic scale on both input and output. 
The logarithmic equivalents are functions 
LgG_D(), LgHJXf and LgG_S() (all cal¬ 
culated by lookup tables). LgG_D() is re¬ 
lated to G d by the formula: LgG_JXLgA) 
=log^G D (£ / #0/0.05); with corresponding 
relations for LgH_D and LgGJS. Zero val¬ 
ues for the geminator are represented on 
the logarithmic scale by a value small 
enough that the eventual value of Din] is 
guaranteed to be zero. 

In summary, a single coarse pixel with 
value Cln] is split into two fine pixels 
with values F(2n] and F(2n+\] by the fol¬ 
lowing sequence of steps. LgD holds the 
value that remains after splitting the pre¬ 
vious pixel. 

LgE=Lg(Ctn+V-Ff2n-\]) ; 

IgA =Lg(dnP Ff2 n -lj); 

IgDeIta=IgD<IgE?IgGHJXlgA):LgGJ(LgA); 

IgD=LgDelta+LgE; 

D[nhXp(LgD); 

F[2n]=C[n}-(D[nJ»\); 

F[2n+\hC[nfr((D[nfr\)»\); 

Here LgGH_D represents either LgG_D for 
horizontal zooming or LgH_D for vertical 
zooming. All functions are calculated by 
lookup tables. The algorithm design com¬ 
pletely eliminates the need for range 
checking on lookup table input. 

Sample Code 

I’ve implemented the augural method de¬ 
scribed here in ZOOMTEST, a sample pro¬ 
gram (available electronically; see “Re¬ 
source Center,” page 5). The program 
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consists of files: IMAGE.H, BMP.H, 
ZOOM.H, ZOOM.CPP, BMP.CPP, and 
ZOOMTEST.CPP. This is intended as an 
example program rather than a finished 
software product, so issues such as error 
checking and interfacing have been kept 
as sparse and unobtrusive as possible. The 
source code is distributed under the terms 
of the GNU public license. 

ZOOMTEST has the usage syntax: 
ZOOMTEST <infile> <outfile>. Input and 
output files are 24-bit BMP format. 

The 24-bit color format is handled by 
zooming the red, green, and blue color 
planes separately. The edges of the im¬ 
age (where F(2n-\] or Cln+1] would fall 
beyond the edge of the image) are han¬ 
dled by effectively setting Fl2n-1] or 
Cl?t+ 1] to Cln] as necessary. 

The augural method requires only a few 
rows of the image held in memory at any 
given time. The design of the example 
program exploits this. I defined an abstract 
base class Image (in IMAGE.H). The ba¬ 
sic idea of an Image is that it writes a spec¬ 
ified number of image rows to a specified 
location in memory on demand. Classes 
derived from Image are BmpFile (defined 
in BMP.H and BMP.CPP), which allows 
rows to be read from a 24-bit BMP file; 
and HZoom and VZoom (both defined in 
ZOOM.H and ZOOM.CPP), which double 
the horizontal and vertical resolution of 
an image, respectively. 

ZOOMTEST.CPP provides a simple 
command-line interface. It opens a BMP 
file, zooms it vertically and then horizon¬ 
tally, and then writes the resulting image 
to a new BMP file. ( VZoom should pre¬ 
cede HZoom , because their geminators 
differ. HZoom followed by VZoom will 
produce inferior results.) 

The core of the zooming process is 
embodied in the procedure SplitPxlO 
found in ZOOM.CPP. This procedure ac¬ 
tually splits a red, green, or blue pixel 
component. 

Enhancements 

The principles outlined here can be fur¬ 
ther developed. More detailed calculations 
allow the resolution to be increased by 
an arbitrary factor, rather than simply dou¬ 
bled. A more sophisticated analysis of im¬ 
age structure using two-dimensional in¬ 
formation yields more precise and 
complete location of edges for better im¬ 
age quality. A commercial version of the 
augural zoomer includes these enhance¬ 
ments, and also incorporates Intel ma¬ 
chine code for greater speed. (For more 
information, send e-mail to sarmstrong® 
jpg.com.) 
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Automated Builds 


A powerful tool for 
rapid development 


Aspi Havewala 

A utomated builds refer to a series of 
commands that can be executed to 
compile and link source code into its 
final deliverable format. Additionally, 
once deliverables are available, they can be 
packaged with an installation program. 

So why is this such a big deal? Well, if 
‘ your product is made up of several mod¬ 
ules (each built separately), you have to in¬ 
tegrate all these builds. To do so, you tra¬ 
verse the directory of each module, build 
the source, and establish intermediate and 
output directories that are common repos¬ 
itories. However, GUI-based development 
environments (such as Visual Studio IDE) 
encourage interactive rather than batch 
builds. But die advantages of creating a sin¬ 
gle, unified build process that can be run 
in batch mode—automated and unat¬ 
tended— can be leveraged in many ways. 
In this article, I’ll discuss some of those ad- 
vantages, whet your appetite with some im¬ 
plementation ideas, and suggest some fea¬ 
tures your build can incorporate. 

The Build Server 

A build server is a machine dedicated to 
the singular purpose of running automat¬ 
ed builds. This machine has to be set up 
with all the tools required to build and 
package your source code. Once estab¬ 
lished, it should require an order of 


Aspi is the author of Building Powerful 
Platforms with Windows CE (Addison- 
Wesley-Longman, 2000). He can be con¬ 
tacted at ahavewala@hotniail.com. 


Congress to change the environment on 
your build server. Although this may 
sound draconian, it ensures that your au¬ 
tomated builds are performed correctly 
and predictably. 

It is best to assign a single person as 
the “build captain” who ensures that the 
automated build is executed correctly and 
regularly and with due process. Your pro¬ 
ject likely won’t have an automated build 
to start with, especially if code is being 
written from scratch. However, you should 
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deploy one as soon as possible. A good 
time to put an automated build in place 
is as soon as you add the first files to ver¬ 
sion control. 


Automated Builds 

Automated builds provide many benefits, 
the first and foremost of which is ready- 
to-go source code. Code that is always 
ready to build saves time. Imagine a test¬ 
ing team preparing several machines to 
start a testing cycle. If they can’t build the 
modules for testing, time is wasted for 
both the development team (scrambling 
to fix problems) and the testing team 
(twiddling their thumbs). 


The next benefit is a reproducible build. 
A reproducible build successfully creates 
output files that are identical to those cre¬ 
ated by a previous iteration of the build. 
To ensure that one file is identical to an¬ 
other, you can compare them bit by bit 
via a file-comparison utility. You can use 
the same build process to build output 
files on two identical machines and still 
end up with differences in your output 
files. The files may even function in the 
same way regardless of the machine they 
were built on. However, differences in 
even a byte between the same file should 
set off alarm bells. 

In theory, a single byte differential could 
cause code to crash in certain situations. 
Such differences are usually the result of 
subtle differences in the build environ¬ 
ment between different machines. An in¬ 
cremental version difference between the 
compilers, a particular registry setting 
made on one machine but not on anoth¬ 
er, a difference in the include paths, and 
the like, can all cause different builds to 
pop out of identical machines. 

Some project leaders tiy to solve this 
problem by assigning the build of a par¬ 
ticular module to a certain team mem¬ 
ber. This supposedly ensures that the 
modules produced by team members are 
reproducible since they come from the 
same machine each time. But this is a risk 
you’re better off not taking. Team mem¬ 
bers fall ill, go on vacation, or decide to 
quit and take a job in Hawaii. Once in a 
while, they might install a productivity 
application, say, NukeEmToPulp 1.0, 
which can change an environment setting 
or two and forever alter the build envi¬ 
ronment without anyone else knowing. 

Also, consider a customer who comes to 
you with a bug in version 1.12. Meanwhile, 
your source code is now at version 2.0. It’s 
not reasonable to expect customers to up¬ 
grade to 2.0 just so you can work on a bug. 
Nope, you are going to have to work with 
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(continued from page 60) 
version 1.12. If you’ve followed the rules of 
source-code version control (see my arti¬ 
cle ‘The Version Control Process,” DDf May 
1999), you will have established a version- 
control label for version 1.12. Thus, you cm 
extract all the files for version 1.12, build 
them, and reproduce your customer’s bug. 
At this point, you want to guarantee that 
the files you build from the checkpoint are 
the same you shipped to the customer. A 
reproducible build facilitates reproducing 
the bug. 

Another benefit is the unattended 
build. At some point in your project— 
especially around the beta stage, when 
your project enters an incremental bug 
fixing and testing pattern—you want to 
build source code repeatedly and often. 


An unattended build scheduled to run 
on the build server facilitates this. You 
can run the unattended build overnight 
and have the latest version of code ready 
for testing on a shared drive by morn¬ 
ing. By giving the testing team access to 
this shared drive, you automate the pro¬ 
cess of handing over the latest source 
code for testing. In effect, the latest 
source code to be tested is always avail¬ 
able on the shared drive of your build 
server. Better yet, you could bundle your 
modules with the installation program 
for your modules and create a directory 
for installation. This process also has the 
desirable side effect of forcing you to 
think about installation, which is often 
treated as a poor cousin during devel¬ 
opment. 


In this way, you encourage the testing 
team to test the correct modules. Tltis elim¬ 
inates the unproductive, but common, sce¬ 
nario in which a test engineer, working on 
a particular version and unaware of up¬ 
dates, reports a problem that has already 
been fixed. However, when the latest ver¬ 
sions of modules are available on a build 
server, the test engineer can come in, chug 
on a cup of coffee, and double-click the 
installation program before beginning a 
fresh round of testing. Not only are the 
most recent changes tested, but the instal¬ 
lation program is also put through its paces 
every day. 

Automated builds are also beneficial 
to developers. This feature is particular¬ 
ly valuable for large projects that take a 
long time to build. My article “The Ver¬ 
sion Control Process” discussed the need 
for all developers to work with the lat¬ 
est source code every day. This practice 
lets you identify integration problems al¬ 
most as soon as they occur, thus keep¬ 
ing the project on track. If files are be¬ 
ing changed constantly, especially a file 
like IncludeMeEverywhere.il that is used 
by virtually every module, each devel¬ 
oper spends a substantial amount of time 
building modules that they don’t neces¬ 
sarily want to test. Worse yet, all devel¬ 
opers spend time on this task every time 
source code is updated. 

By providing fresh builds everyday on 
a build server, you give developers the 
option of downloading the output and in¬ 
termediate files directly onto their hard 
disk along with the latest source from ver¬ 
sion control; thus, saving the time required 
to build these modules. An incremental 
build can then be performed, which will 
build only the files that have been modi¬ 
fied by that particular developer. 

This productivity benefit also allows de¬ 
velopers to pull down the retail versions 
of the modules and mix them with a de¬ 
bug build or a module that they are de¬ 
bugging. If there is a situation that war¬ 
rants debugging an associated module, 
the debug build for that module can sim¬ 
ply be downloaded from the build server 
and copied to its rightful place on the de¬ 
veloper’s hard disk. 

Size tracking is another benefit provid¬ 
ed by automated builds. Executable files 
and libraries grow in size at the rate at 
which code is added. Source code addi¬ 
tions are directly related to new features 
or bug fixes. However, a new compiler 
or linker switch can also cause a signif¬ 
icant change in the size of an output file. 
A function call that pulls in calls from 
several other libraries can also result in 
a significant size increase in the final out¬ 
put. This is usually inadvertent. Devel¬ 
opers often don’t pay careful attention 
to how much code they are pulling into 
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their module when creating a function 
call that resides in an external library. By 
running automated builds daily, you are 
in the position to incrementally track the 
changes in size of output files. This lets 
you correct problems such as those I just 
described. You can also write a small 
utility that saves the size of your output 
files and compares them between builds. 
You can set it up to warn you if the size 
of a module changes beyond a given 
percentage. Alternately, you can chart 
the change in size for each module reg¬ 
ularly and use the information when con¬ 
ducting code reviews. 

Another tangible benefit to having an 
automated build is the ability to get new 
team members started quickly. Once all 
the tools are installed and the source code 
has been pulled from version control, a 
single command can build all the mod¬ 
ules from scratch. For new team members, 
setting up the environment and building 
the source successfully represents a sig¬ 
nificant milestone. 

Makefiles: A Basic Primer 

It is important to create an automated 
build process in the form of one or sev¬ 
eral commands that can be invoked from 
a single batch file. The prevalent way of 
creating build processes is by writing 
Makefiles—scripts that are read and in¬ 
terpreted by the Nmake utility. Central to 
Makefiles is the concept of a target and 
its dependents. 

In Example 1(a), for instance, the tar¬ 
get is checked against its dependents, De- 
pendentl through DependentN. If any of 
the dependents is newer than the target, 
the block of commands immediately fol¬ 
lowing that line is executed. This check¬ 
ing and execution of commands is per¬ 
formed by the Nmake utility. 

Example 1(a) can be extended to build 
the source code for an executable. In Ex¬ 
ample 1(b), the Alarm executable depends 
on several object modules. This depen¬ 
dency represents a rule for building 
Alarm.exe. If either of the object files is 
newer than Alarm.exe, the link command 
is executed, building a new Alarm.exe. The 
special variable $@ is set by Nmake to the 
target being processed. The variable $** 
is set to die list of dependents. You can use 
such variables to simplify your Makefile 
scripts. In my sample Makefile, I use these 
variables to create generic command lines 
for common tasks. 

The object files are built if any of the 
corresponding source files become out¬ 
dated. This rule is captured in a generic 
way by the .c.obj construct, which instructs 
Nmake to build any object file if it can find 
a .c file of the same name that is newer. 

Nmake sets internal variables with val¬ 
ues that can be retrieved by the $() op¬ 


erator. Nmake also sets some predefined The variable LINK is set to link.exe. You 
variables to default values. For exam- can override these definitions by setting 
pie, CC is set to the command cl.exe. the variables yourself, and you can reduce 


(a) 

Target: Dependentl Dependent2 ... DependentN 
Commandl 
Command2 

(b) 

Alarm.exe: Time.obj Date.obj SetAlarm.obj Sound.obj 
$ (LINK) $(LFLAGS) /OUT: $@ $** 

.C.obj: 

$(CC) $(CELAGS) 

(C) 

CC=MyCl.exe 
LINK=MyLink.exe 
LFLAGS = 

CFLAGS = -c -0 


Example 1: (a) Target is checked against its dependents; (h) extending the 
build; (c) reusing a set of linker and compiler flags. 
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Name 

Purpose 

Examples 

Paths.mk 

Defines variables 
used to abstract and 
centralize path and 
folder names. 

PATH ALARMCLOCK = AlarmClock 

PATH ALARMCLOCK INCLUDE = 
$(PATH_ALARMCLOCK)\Common\lnclude 

Shell.mk 

Defines variables used 
to abstract shell script 
language and commands. 

COPY = xcopy 

DISPLAY = echo 

Options.mk 

Defines variables that 
modify the build process. 
This is also a good place 
to set up compiler and 
linker options. 

DEBUG = 1 

VERBOSE = 1 

CLFLAGS = $(CFLAGS) -W3 

Vc.mk 

Defines variables for 
version-control command 
line and flags. 

VC_CMD = Ss.exe 

Targets.mk 

Defines rules for 
reusable targets. 

Clean: 

Install: 


Table 1: Functionality of the included Makefiles. 


platform dependencies in your Makefile 
by using such variables. The variables 
LFLAGS and CFLAGS , see Example 1(c), 
let you reuse a set of linker and compil¬ 
er flags in various places without having 
to repeat them throughout your Makefile. 

In short, you can use Makefiles to build 
executables, libraries, and even perform 
all kinds of odd jobs—including copying 
and deleting files. 


Creating an Automated Build 

To create an automated build, I’ll use a 
sample called “AlarmClock”— a module 
that provides online alarm services for ho¬ 
tel guests. The automated build creates 
the executable for this application. As Fig¬ 
ure 1 shows, the source code is organized 
in separate directories: Alarm holds files 
related to triggering the alarm, DateTime 
houses files that manipulate the date and 


time, and Userlnterface contains files that 
interact with users. Finally, Common holds 
code shared between all the directories. 
In this example, I use it to hold some 
header files. 

Designing the 
Makefile Implementation 

Besides being able to build the entire pro¬ 
ject, Makefile must also be extensible. By 
designing the Makefile implementation 
carefully, you can create components that 
can be reused by other projects. 

As you can see in Figure 2, the master 
Makefile is made up of several smaller 
Makefiles. Each included Makefile ad¬ 
dresses a particular area of functionality. 
Table 1 describes the functionality of the 
included Makefiles. I define a variable 
that abstracts the root directory, \Dev- 
root. I use this directory to find every 
other directory used in the project. By 
formalizing a directory structure for your 
projects, you make them more manage¬ 
able and maintainable. Most developers 
really don’t want to change the directo¬ 
ry structure or rename directories. It’s 
unproductive and the benefits gained 
can be obtained in other ways. In this 
Makefile, I let you specify an alternate 
name for the root directory only. If you 
define an environment variable called 
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Figure 1: Folder and file structure for the AlarmClock sample. 
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Shell.mk 
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Options.mk 
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Vc.mk 

Shell Commands 

Path names 

Project Options 

Reusable targets 

Version Control 
Integration 


Figure 2: Makefile implementation. 


“PATHJDEVROOT the Makefile will use 
this definition and will not create a de¬ 
fault definition. I use this technique in 
the Makefile whenever I want to let you 
override defaults. 

Once the root directory has been set 
up, you use it to find the directory, which 
is home to your included Makefiles. The 
first Makefile I include, Paths.mk, maps 
the directory structure of the project to 
variables that can be used in other Make¬ 
files. You include your final Makefile, Tar- 
gets.mk, at the end of the master Make¬ 
file. The Nmake utility requires you to 
set up all definitions and declarations be¬ 
fore you can specify rules for targets. 
Since Targets.mk contains only rules, it 
must be included after all definitions in 
the Makefile have been specified. You 
formalize this by specifying that it be in¬ 
cluded at the end of the master Make¬ 
file, by which time you will have finished 
defining all variables. 

Analyzing the Included Makefiles 

Listing One (Paths.mk) sets up variables 
that define a temporary director)- for in¬ 
termediate files and a release directory 
for output files. These variables are used 
in compiler and linker flags to direct out¬ 
put files. Directories that are reposito¬ 
ries for intermediate and output files 


have separate paths based on whether 
the build is a debug or retail build. This 
separation lets users switch between de¬ 
bug and retail builds without having to 
rebuild all the components again. 
Paths.mk requires a special variable 
called “ PATHJiOME ” to be defined in 
the master Makefile. This variable de¬ 
fines the directory that contains the mas¬ 
ter Makefile and will be the base direc¬ 
tory for running the automated build. If 
this variable is not set, Paths.mk aborts 
the build using the letror directive. 

Listing Two (Shell.mk) sets up defini¬ 
tions for commands. The only interesting 
thing going on here is the way the VER¬ 
BOSE option is supported. When build¬ 
ing source, especially when modifying the 
build process itself, you might need to 
look at the sequence of commands being 
executed by the Makefile. (Normally, 
you’d choose to liide these commands be¬ 
cause they create a lot of screen clutter.) 
By specifying the VERBOSE=l option 
when calling Nmake, you can see each 
command being executed. When \ / ERBOSE 
is not set to 1, you can hide all commands 
by prefixing them with die @ operator. The 
intermediate variable CMDECHO holds the 
value of die prefix. It is set to eidier @ or 
NULL , according to die value of the VER¬ 
BOSE option. 
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Listing Three (Options.mk) specifies 
compiler and linker flags. The value of 
these flags changes depending on the 
value of the DEBUG option. You use the 
value of DEBUG to specify compiler 
switches for optimization and debugging. 
If the NOBROWSE flag is set to NULL, you 
set up the compiler and linker switches 
to build a browser database for the 
source. 

Finally, you define variables for com¬ 
mands that can compile, link, and gener¬ 
ate a browser database. These commands 
can be plugged into a Makefile as required 
to perform their respective tasks. You will 
see examples of this in the master Make¬ 
file, which uses the commands COM - 
PILEME, UNKME , and BUILDBROWSERDB . 
If a compiler or linker supports new 
switches, these can be added to the in¬ 
cluded Makefile without having to change 
every single master Makefile that uses the 
compiler and linker. Vc.mk defines vari¬ 
ables that are useful when integrating with 
version control. 

Listing Four (Targets.mk) sets up rules 
for some useful targets. This includes a 
Clean target to delete intermediate files. 
A Usage target displays help on how to 
use the Makefile. A Setup target creates 
the temporary and release directories if 
none exist. 

The Clean and Usage targets have a 
double semicolon (::) in front of them. 
This is used in a Makefile when there are 
multiple rules for the same target. Nmake 
will process both sets of rules. Thus, a 
Clean target can also be setup by the mas¬ 
ter Makefile to delete some files that the 


included Makefiles don’t know about. For 
example, in the master Makefile, I define 
an additional Clean target to clean up the 
output files. 

Adding AlarmClock 
to the Automated Build 

Listing Six is the Makefile in the \Dev- 
RootXAlarmClock directory. You must set 
up some paths in the master Makefile pri¬ 
or to including Paths.mk because you 
want to be able to find the include Make¬ 
files first. Take the opportunity to define 
the PATH_HOME variable, which is ex¬ 
pected by Paths.mk. 

The master Makefile specifies additions 
to any compiler or linker switches setup by 
the include Makefiles. In the sample, you 
add some project-specific switches to the 
compiler. You then define some rules for 
the targets that are to be built. The first rule 
is for a target called “ All ' ” which is invoked 
every time the Makefile is parsed. The de¬ 
fault is to build AlarmClock.exe, which de¬ 
pends on a number of object files that have 
rules specifying how they need to be built. 
When referring to the location of the out¬ 
put and intermediate files, you liberally use 
the variables defined in Paths.mk. Devel¬ 
opers are thus insulated from creating these 
directories manually for every project. 

You use predefined variables COM - 
PILEME to compile and UNKEME to link. 
Developers who write the Makefile are 
thus insulated from the internals of how 
to invoke the compiler and linker. 

Finally, you include die Targets.mk file 
at the end. That’s it. All you need to do is 
type in Nmake and you are off to die races. 


Integrating with Version Control 

Although you now have an easy-to-use 
build process that can run unattended, 
you have one more important step to per¬ 
form before scheduling automated builds 
on a build server—you need some way 
of getting all the latest source code be¬ 
fore building it. This requires integration 
with your version-control software. 

Listing Five is a sample included Make¬ 
file called “Vc.mk’’ that can be called to 
copy the latest version from your version- 
control database onto the hard disk on the 
build server. This Makefile defines variables 
diat abstract any specific version-control 
software. The Refresh target in the master 
Makefile uses the defined variables to pull 
source code. The reason you provide a 
separate target is because you don’t want 
refreshing source code to be a conscious 
decision made by the person who invokes 
the Makefile. If the target were integrated 
in such a way that it was invoked every 
time a developer wanted to build source, 
you would open Pandora’s box. 

Conclusion 

By creating a structure for writing project- 
based Makefiles, you can create an auto¬ 
mated build process for a project. Such a 
process provides a model for creating 
unattended, centralized, and repeatable 
builds. These features can be leveraged 
in many different ways to streamline a 
project. 
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Listing One 

############################################################################# 

* \DevRoot\Build\Include\Paths.mk 

* Include Makefile for automated build process. 

* Defines directory paths for stock directories used for the build. 

* (c) Aspi Havevala 1998 

##############••######## 1 #################################################### 
lifndef PATH.HOME 

I error Please define a variable called PATH_H0ME. The directory 

specified by this variable vill be hold your intermediate files. 

!endif 

_T_PATH_TEMP = $(PATH.HOME)\Temp 
.T.PATH.RELEASE = $(PATH.DEVR00T)\Release 
Iif "$(DEBUG)"=="1" 

PATH.TEMP = $(_T.PATH.TEMP)\Debug 
PATH.RELEASE = $(.T.PATH.RELEASE)\Debug 
lelse 

PATH.TEMP = $(_T.PATH.TEMP)\Retail 
PATH.RELEASE = $(.T.PATH.RELEASE)\Retail 
!endif 


Listing Two 

# \DevRoot\Build\Include\Shell.mk 

# Include Makefile for automated build process. 

« Defines shell commands used in the build process. 

# (c) Aspi Havevala 1998 

I !#######! ##IM##M######tf ##IM#MI#########l#####l##f #11 #lf#####f #####M#tt# 

!if "$(VERBOSE)"I="1" 

CMDECHO = @ 

Iendif 

DISPLAY = $(CMDECHO)echo 
IFF = $(CMDECHO)if 


COPY = $(CMDECHO)xcopy /S /E 

DELETE = $(CMDECHO)del /q 

DELTREE = $(CMDECHO)rmdir /S /Q 

MAKEDIR = $(CMDECHO)mkdir 

CC = $(CMDECHO)cl /nologo 

LINK = $(CMDECHO)link /nologo 

BROWSERBUILDER = $(CMDECHO)bscmake /nologo 


Listing Three 

ft#########*#######################################*########*######*#*####*## 

# \DevRoot\Build\Include\Options,nk 

= Include Makefile for automated build process. 

# Defines options that modify the build process. 

# (c) Aspi Havevala 1998 

####*######*#######*######»*################»#*##############*#*»#«#»#*#*###* 

# Specify compiler options 

# Compile only - /c 

# Name temporary file - /Fo 
CFLAGS = /c /Fo$*.obj 

# If brovser option off 

# Name brovser file - /Fr 
Iif "$(NOBROWSE)"!="1" 

CFLAGS = $(CFLAGS) /Fr$*.sbr 
!endif 

# If debug build. 

# Turn off optimizations - /Od 

# Generate debug info - /Zi 

# else 

# Enable global optimization - /Og 
!if "$(DEBUG)"=="1” 

CFLAGS = $(CFLAGS) /Od /Zi 
lelse 

CFLAGS = $(CFLAGS) /Og 
!endif 

(continued on page 68) 
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(continued from page 66) 

« Define a generic line for compiling a source file 
COMPILEME = $(CC) $(CFLAGS) $** 

* Specify linker options 

4 Name output file - /OUT: 

LFLAGS = /OUT:$0 /LIBPATH:"$(MSDEVDIR)"\. .Wc\Lib /PDB:$*.pdb 
/MAP:$*.map 

!if "$(DEBUG)"=="1" 

LFLAGS = $(LFLAGS) /DEBUG 

lelse 

lendif 

* Define a generic line for linking 
LINXME = $(LINX) $(LFLAGS) $** 

8 Define a generic line for building a browser database 
!if "$(NOBROWSE)"!="1" 

BUILDBROWSERDB = $(BROWSERBUILDER) /o $*.bsc $(PATH.TEMP)\*.sbr 
lendif 


Listing Four 


$(DISPLAY) " 
targets 

$(DISPLAY) " 
files 

$(DISPLAY) " 
message 

$(DISPLAY) 
"Options 

$(DISPLAY) " 
process " 

$(DISPLAY) " 
database " 

$(DISPLAY) " 
debug 


All: Builds all 

ii 

Clean: Cleans all output 
Usage: Displays this 

VERBOSE =0/1: Displays trace for build 
NOBROWSE = 1/0: Disables building of browser 
DEBUG = 0/1: Builds for retail or 


Listing Five 

#1# tiff ###t##tMtti4M#9$9#i###f#i##t#4###t#M#itt#########f tit ll######i##t#fi 

* \DevRoot\Build\lnclude\Vc.mk 

4 Include Makefile for version control integration. 

4 Defines variables for version control command line and flags 
4 (c) Aspi Havewala 1998 


* Version Control command line to refresh all source. 
VC.CMD = -"$ (MSDEVDIR)\..Wss\Win32\Ss.exe" Get $$/ 


4 \DevRoot\Build\lnclude\Targets.mk 
4 Include Makefile for automated build process. 

4 Defines rules for stock targets for the build process. 

8 (c) Aspi Havewala 1998 

ttf##f#t##tttttf##tttttttttt##ftttttttitlfttttttttt##ttti«##ltttttttttttttttt# 

« Rules for building temporary and release directories. 

Setup: $(PATH_RELEASE) $(PATH_TEMP) 


4 Version control flags. Note that this requires a special user called 
4 Builder to be created by the Version Control administrator. 

VC.FLAGS =-I-Y -R -YBuilder -GTU 

« If clean refresh, specify additional flags. 

!if "$(CLEAN)"=="1" 

VC.FLAGS = $(VC.FLAGS) -GWR 
lendif 


$(PATH.RELEASE): $(.T.PATH.RELEASE) 

$(IFF) not exist $0 $(MAKEDIR) $0 
$(.T.PATH.RELEASE): 

$(IFF) not exist $0 $(MAKEDIR) $0 
$(PATH_TEMP): $(_T_PATH_TEMP) 

$(IFF) not exist $0 $(MAKEDIR) $0 
$(_T.PATH.TEMP): 

$(IFF) not exist $0 $(MAKEDIR) $0 
8 Rule to clean up temporary files. 

Clean:: 

$(IFF) exist S(PATH.TEMP) $(DELTREE) $(PATH_TEMP) 
Usage:: 

$(DISPLAY) "nmake [Targets] 

[Options] " 

$(DISPLAY) 

"Targets 
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ERP Systems 


Enterprise Resource Planning 
Systems 

Systems, Life Cycles, Electronic Commerce, 

and Risk 

Daniel E. O'Leary 

• Examines the pros and 
cons of ERP systems 

• Provides a step-by-step 
guide through the ERP 
life-cycle 

• Ties ERP systems to 
e-commerce 

• Lays out the critical 
success factors for ERP 
systems 

• Offers several case studies 

2000 c.240 pp. 

0-521-79152-9 Hardback 


Listing Six 

ttttttt#fttttttttttttt###tt#ttt#tttttttttttt#ittt##tftttitttt##ttttii#tttttttt 

4 \DevRoot\AlarmClock\Makefile 
4 Master Makefile for automated build process. 

4 (c) Aspi Havewala 1998 

■ Define a path for the development root 
lifndef PATH.DEVROOT 

PATH.DEVROOT = \Aspi's~l\Articles\Versio~l\DevRoot 
lendif 

PATH.BUILD.INCLUDE = $(PATH.DEVROOT)\Build\lnclude 

» Set up home directory in predefined variable 
PATH.HOME = $(PATH.DEVROOT)\AlarmClock 
I include <$(PATH.BUILD.INCLUDE)\Paths.mk> 

Iinclude <$(PATH.BUILD.INCLUDE)\Shell.mk> 

Iinclude <$(PATH.BUILD.INCLUDE)\0ptions.mk> 

I include <$(PATH.BUILD.INCLUDE)Wc.mk> 

4 Specify additional compiler flags 

* Optimize for Windows application - /GA 

* Add new directories to include path = /I 

CFLAGS = $(CFLAGS) /GA /l$(PATH.HOME)\Common\lnclude 

4 Specify additional linker flags 
4 LFLAGS = $(LFLAGS) ... 

All: Setup $(PATH.RELEASE)\AlarmClock.exe 

8 Rule for final executable. 

$(PATH.RELEASE)\AlarmClock.exe: \ 

$(PATH.TEMP)\Timer.obj \ 

$(PATH.TEMP)\Date.obj \ 

$(PATH.TEMP)\Time.obj \ 

$(PATH.TEMP)\SetDate.obj \ 

$(PATH.TEMP)\SetTime.obj \ 

$(PATH.TEMP)\Sound.obj 

$(LINKME) 

$(BUILDBROWSERDB) 

8 Rules for compiling individual source files. 

$(PATH.TEMP)\Timer.obj: Alarm\Timer.cpp 
$(COMPILEME) 

$(PATH.TEMP)\Date.obj: DateTine\Date.cpp 
$(COMPILEME) 

$(PATH.TEMP)\Time.obj: DateTime\Time.cpp 
$(COMPILEME) 

$(PATH.TEMP)\SetDate.obj: UserInterface\SetDate.cpp 
$(COMPILEME) 

$(PATH.TEMP)\SetTime.obj: UserInterface\SetTime.cpp 
$(COMPILEME) 

$(PATH.TEMP)\Sound.obj: UserInterface\Sound.cpp 
$(COMPILEME) 

4 Clean up all output files. 

Clean:: 

$(IFF) exist $(PATH.RELEASE)\AlarmClock.exe $(DELETE) 

$(PATH.RELEASE)\AlarmClock.exe 

8 Get latest copy of source code from version control. 

Refresh: 

S(CHANGEDIR) $(PATH_DEVR00T) 

$(VC_CMD) $(VC.FLAGS) 

Iinclude <$(PATH.BUILD.INCLUDE)\Targets.mk> 
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Examining 

VMware 


VMware'’s virtual 
machine platform lets 
users crash at will 

Jason Nieh and 
Ozgur Can Leonard 

V Mware is a virtual-machine platform 
that provides an abstraction of x86 
PC hardware so that multiple oper¬ 
ating systems can run unmodified 
and at the same time on a standard PC. 
For developers, this means you can run 
multiple development environments on 
your desktop without rebooting or repar¬ 
titioning. In the process, you can isolate 
and protect operating environments (and 
the applications and data that are running 
in them), as well as interoperate among 
operating systems for networking, de¬ 
vice/file sharing, and cut-and-paste. For 
users, VMware makes it possible to run 
Windows applications with Linux. VMware 
comes in two flavors, depending on the 
operating system running on the user’s 
Pentium-based (or compatible) PC— 
VMware for Linux, and VMware for Win- 

Jason is an assistant professor of comput¬ 
er science at Columbia Univeisity. He can 
be reached at nieh@cs.columbia.edu. Can 
was a teaching assistant for the operating- 
systems course at Columbia. He can be 
reached at ocl3@cs.columbia.edu. 
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dows NT/2000. VMware installs like an 
application program, requiring no special 
hardware support. 

In this article, we’ll present a different 
perspective by discussing our experi¬ 
ences teaching operating-systems cours¬ 
es at Columbia University (http://www 
.cs.columbia.edu/~nieh/teaching/w4ll8). 
Using Linux and VMware, we were able 



to give students a flexible virtual kernel- 
level development environment in which 
operating systems can be developed, de¬ 
bugged, and rebooted in a shared com¬ 
puting lab environment without affecting 
other application users. 

Projects in operating-system courses 
typically can be categorized as user level 
or kernel level: 

• User-level projects require only devel¬ 
oping code designed to run in unprivi¬ 
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leged mode. Examples of such projects 
include writing modules for a user-level 
simulator such as Nachos (see The Na- 
chos Instructional Operating System, 
http://littp.cs.berkeley.edu/~tea/nachos/ 
nachos.ps), user-level threads program¬ 
ming, or systems programming with a 
commercial operating system such as So¬ 
laris or Windows NT. 

• Kernel-level projects require writing or 
modifying code designed to run in su¬ 
pervisor mode. Examples of such pro¬ 
jects include writing a small kernel from 
scratch, studying die internals of a ped¬ 
agogical operating system such as Minix 
(http://www.cs.vu.nl/~ast/minix.html), 
or possibly modifying the kernel of a 
commercially available, full-featured op¬ 
erating system. 

The latter is made possible due to the 
increasing popularity and maturity of freely 
available open-source operating systems 
such as Linux and BSD variants. 

OS courses with only user-level student 
projects are more common because die 
projects are typically no more difficult to 
set up and administer than other user- 
level applications. While user-level pro¬ 
jects provide students with some hands 
on experience, they don’t provide direct 
kernel-level development experience. 
Consequendy, user-level projects do not 
effectively address important issues such 
as bootstrapping, handling interrupts, the 
kernel-level development and debugging 
process, or understanding the kernel in¬ 
ternals of a full-featured operating system. 

Kernel-level projects, on the other hand, 
provide a better pedagogical vehicle for 

http://www.ddj. com 
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(continued from page 70) 
learning about real-world operating- 
system design and implementation. How¬ 
ever, students must be given root privi¬ 


leges to do many of the tilings required 
for kernel development, such as installing 
new kernels, rebooting, kernel testing and 
debugging, and so on. In addition, stu¬ 


dents typically need exclusive access to a 
computer so that the development cycle 
of plan-implement-reboot-test-debug can 
be done without inconveniencing others. 
For a typically large introductory OS class, 
providing every student with a computer 
on which to run as root to do kernel de¬ 
velopment is difficult to administer and 
prohibitively expensive. As a result, most 
courses can only offer user-level project 
alternatives. 

The VMware Virtual Machine 

Again, VMware (http://www.vmware.com/) 
is a virtual-machine platform that makes 
it possible to run an unmodified operat¬ 
ing system as a user-level application. The 
OS running within VMware can be re¬ 
booted, crashed, modified, and reinstalled 
without affecting the integrity of other ap¬ 
plications running on the computer. In the 
operating-systems class at Columbia Uni¬ 
versity, we used VMware to provide stu¬ 
dents with a virtual kernel-development 
environment in which to work on Linux 
kernel-level projects without requiring a 
separate computer for each student. 
VMware made it possible for us to teach 
operating systems with kernel-level pro¬ 
jects to a class of 140 students, using noth¬ 
ing more than a shared PC lab that was 
simultaneously used by other students for 
general computing needs. 

VMware is a virtual-machine monitor 
that grew from OS research at Stanford 
University. A virtual-machine monitor is 
an additional layer of software between 
the hardware and the operating system 
that virtualizes all of the hardware re¬ 
sources of the machine. It essentially cre¬ 
ates a virtual hardware execution envi¬ 
ronment called a “virtual machine” (VM). 
Multiple VMs can be used at the same 
time, and each VM provides isolation 
from the real hardware and other activ¬ 
ities of the underlying system; see Fig¬ 
ure 1. Because it provides the illusion of 
standard PC hardware within a VM, 
VMware can be used to run multiple un¬ 
modified PC operating systems simulta¬ 
neously on the same machine by run¬ 
ning each operating system in its own 
VM. An OS running as a user-level ap¬ 
plication on top of VMware is called a 
“guest OS.” The native OS originally run¬ 
ning on the real hardware is called the 
“host OS.” 

VMware is low-level enough to make 
a guest OS appear to be receiving hard¬ 
ware interrupts (such as timer interrupts) 
and behave as if it were the only OS on 
the machine. At die same time, it provides 
isolation so that a failure in or misbehav¬ 
ing of a guest OS does not affect other 
guest OSs or the underlying system. For 
instance, a guest OS crashing will not crash 
the underlying system. As opposed to a 
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Figure 1: The VMware virtual platform. 
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software simulator, much of the code run¬ 
ning in a VM executes directly on the 
hardware without interpretation. Only priv¬ 
ileged instructions are trapped and im¬ 
pose additional overhead. The major ad¬ 
vantage of using a VM as opposed to a 
simulator is the performance improvement 
possible through direct execution of un¬ 
privileged instructions. 

Operating systems currently supported 
as guest operating systems under VMware 
include Windows 95/98/2000/NT, Free¬ 
BSD, Solaris, Novell Netware, DOS, and 
Linux, all of which run unmodified. The¬ 
oretically, any OS that can run on an x86 
architecture can run as a guest OS, since 
it will see a complete virtualized PC en¬ 
vironment. For host operating systems, 
VMware currently runs and is supported 
on Windows 2000/NT and Linux. In ad¬ 
dition, there is an unsupported port that 
can use FreeBSD 4.0 as the host OS. We 
used the Linux version of VMware for the 
operating-systems course we taught. 

The virtual-machine monitor in Linux 
is implemented via a loadable kernel mod¬ 
ule that provides the necessary hooks for 
hardware emulation, interrupt generation, 
and other low-level details. There is also 
a GUI, which is the visual interface to the 
virtual machine, and makes VMware look 
like a real computer from the moment it 
boots the VM. 

Teaching Operating 
Systems Using VMware 

For the last few years, the introductory 
operating-systems course at Columbia 
University has been taught using the user- 
level Nachos simulator. As is typical at 
many universities, the computer lab fa¬ 
cility we had available for the course 
could not be used as a dedicated oper¬ 
ating systems lab. Nachos was easy to set 
up and administer in a computer lab 
shared among multiple courses. 

When VMware was introduced, we 
thought it would be a great tool for teach¬ 
ing operating systems because it would 
let us provide kernel-level student pro¬ 
jects in the shared computer lab available 
for the course. To give us the opportuni¬ 
ty to try VMware for our instructional pur¬ 
poses, VMware provided us with evalua¬ 
tion licenses for the course. We used 
VMware 1.03, which was the latest prod¬ 
uct version available before the course 
started. More than 140 students enrolled 
in the course, a 30 percent increase over 
previous years. 

VMware allowed us to configure a guest 
OS as a kernel development environment 
for a group of students. We were able to 
give students root access to guest OSs ain- 
ning in VMs without compromising the se¬ 
curity of the lab machines. Because faults 
that occur in running the guest OS are con¬ 


tained within its respective VM, students 
could crash and reboot their guest OSs 
without interfering with the operation of 
the host OS. It was thus possible to retain 
the shared staais of the computer lab we 
used, because students working on other 
projects could be sharing the same com¬ 
puter as a group debugging their kernel. 

Using VMware, our operating-systems 
class focused on die kernel internals of Lin¬ 
ux. Students were able to learn in-depth 
about the kernel design and implementa¬ 
tion of a widely deployed operating sys¬ 
tem, and gained valuable software experi¬ 
ence in working with a large body of 
source code. The experience gained by 
such work is directly applicable to the kind 
of operating-systems work that students 
will encounter in the industry. We chose 


Linux in particular due to die extensive on¬ 
line documentation available, as well as the 
immense popularity it enjoys. Students were 
more interested in doing the projects be¬ 
cause they were working with something 
they felt was practical and relevant. The 
kernel-level projects we assigned were: 

• Familiarization with the kernel and sys¬ 
tem calls. Students learned how to build 
and run an operating system. They then 
modified die behavior of an existing sys¬ 
tem call and created a new system call. 

• Schedulers. Students implemented two 
new weighted round-robin schedulers, 
and evaluated their effectiveness as al¬ 
ternatives to the regular Linux scheduler. 

• Memory management. Students modi¬ 
fied the Linux memory management in- 
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temals to change the criteria used to de¬ 
termine how much main memory a pro¬ 
cess could use and what pages were 
swapped out. 

• File systems. Students modified the block 
allocation scheme used in the ext2fs file 
system, and observed the resulting per¬ 
formance differences. 

• Device drivers. Students implemented a 
kernel device driver, dev/clock, as a load¬ 
able kernel module interfacing to the get- 
timeofday/settimeofday system calls. 

VMware was indispensible for the im¬ 
plementation and testing of the project as¬ 
signments, and provided a framework in 
which students were able to observe the 
correctness and performance of their im¬ 
plementations. 

VMware Setup 

The shared computer lab we used for 
the course included 24 student machines: 
12 333-MHz Intel Pentium II PCs with 
128 MB of RAM, and 12 266-MHz AMD 
K6 PCs with 64 MB of RAM. Each ma¬ 
chine had a 4 GB local disk and ran Red 
Hat Linux 6.0 with the X Windowing sys¬ 
tem. All of the machines NFS-mounted 
users’ home directories from a separate set 
of file servers. Given the class size and the 
number of machines available, we conser¬ 
vatively grouped students into 43 project 
groups of 3-4 students, with two groups 
assigned to each machine. Each group was 
given its own VM and guest OS. 

The process of setting up VMware and 
the guest OS on a single Linux machine is: 

1. Download the VMware for Linux bina¬ 
ries and kernel modules. 

2. Install VMware, which needs to be 
done as root in order to load the ker¬ 
nel modules. 

3. Obtain a VMware license and save the 
license file in your home directory. 

4. Start VMware and follow the step-by- 
step instructions provided by the 
VMware GUI to define a VM hardware 
configuration to export to the guest OS. 

5. Insert the installation media (floppy, CD- 
ROM) for the guest OS and press the 
Power On button in the VMware GUI. 

The installation for the guest OS then 
proceeds in the same way as it would for 
installing the OS directly on the comput¬ 
er. The VMware VM configuration is saved 
to a plain-text config file that may later 
be modified without having to reinstall 
the guest OS. We discuss later the various 
VM configuration options for disk, mem¬ 
ory, and networking, and explain the op¬ 
tions we used to ensure proper security 
in a shared lab environment. 

The VM disk configuration options de¬ 
termine how disk partitions mounted by 
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the host OS are used to export a virtual 
storage device to the guest OS. VMware 
lets the guest OS mount raw disk parti¬ 
tions or use virtual disks. A virtual disk in 
VMware is simply a large file in the host 
OS file system that is treated by the VM as 
an IDE disk. We configured the VMs to 
use virtual disks so that disk problems 
caused by a misbehaving guest OS that a 

VMware makes 
it possible to run 
an unmodified 
operating system 
as a user-level 
application 


student installed would not affect the host 
disk partitions. The use of virtual disks 
made it simpler for students to reinstall a 
guest OS in die event of a disk crash in die 
VM. Because a virtual disk is just a regular 
file on the host OS file system, we just pro¬ 
vided clean versions of the virtual disk so 
that students could use them to overwrite 
their own in case of unrecoverable disk 
crashes in die VM. VMware also has an op¬ 
tion of marking virtual disks and raw par¬ 
titions as “undoable,” which lets changes 
be discarded at die end of a VMware ses¬ 
sion. This can prevent unwanted and ac¬ 
cidental modifications to the guest OS file 
system from becoming permanent. 

We allocated two 500 MB local disk par¬ 
titions on each macliine, then created a vir¬ 
tual disk in each partition. The 500 MB of 
disk space was necessary for providing a 
Red Hat Linux kernel development envi¬ 
ronment. The Linux development tools and 
source code required roughly 400 MB of 
space. This did not include the X Window 
system, which was not necessary in the 
guest OS installation for our class projects. 
We installed the virtual disks on die local 
disks as opposed to the NFS-mounted file 
servers for performance reasons. In addi¬ 
tion, die local disks were not backed up 
due to the network, and disk-space re¬ 
sources that would be required to do this 
for each of die 45 student project groups. 
Restricted access to the virtual disks was 
achieved using user groups. The lab sys¬ 
tem administrator created a number of user 
groups for the course, and set permissions 

Dr. Dobb’sJournal, August 2000 


on the virtual disks such that they could 
only be accessed by the teaching staff or 
members of the respective user group. Stu¬ 
dents were each assigned to one user 
group. As a result, even diough it was pos¬ 
sible to start VMware from any of the ma¬ 
chines in the lab, virtual disks were pro¬ 
tected from unauthorized access via 
standard Linux file permissions. 

The VM memory configuration options 
determine the amount of host system 
memory diat die VM is allowed to use. This 
option is one of the primary determining 
factors in die performance of the guest OS 
environment in the respective VM. To sim¬ 
plify administration, we used the same VM 
memory configuration for all of the Linux 
machines, despite die fact that some of the 
machines had more memory than others. 
Since some of the Linux machines had only 
64 MB of RAM and needed to support two 
VMs as well as odier users, we configured 
each VM with only 16 MB of RAM. More 
recently, all of the Linux machines have 
been upgraded to 128 MB of RAM. If the 
extra memory had been available when 
the class was taught, we would have con¬ 
figured each VM with 32 MB of RAM for 
better performance. 

The VM network configuration options 
determine the type of networking avail¬ 
able to the guest OS. The options are no 
networking, host-only networking, and 
bridged networking. The no-networking 
option does not export a network inter¬ 
face to the VM. The host-only network¬ 
ing option exports a network interface to 
the VM that only allows communication 
between the VM and the host machine. 
Under bridged networking, the host OS 
acts as a bridge between the VM and the 
LAN, effectively allowing the VM to run 
as a real networked machine with an IP 
address. To let students access their files 
on the host file system and the NFS- 
mounted file servers, we configured the 
VMs for host-only networking. Using host- 
only networking, students were able to 
use FTP to backup their work onto their 
regular home directories, which alleviat¬ 
ed many of the problems of a virtual disk 
crash while working on an assignment. 
We did not provide full bridged net¬ 
working to the VMs because of the secu¬ 
rity implications of allowing students to 
have root access on a full networked ma¬ 
chine on a LAN. 

We found the configuration of the guest 
Linux OS we used to be fairly straight¬ 
forward. Since VMware emulates standard 
devices such as IDE disks and PCI Ether¬ 
net cards, installing Linux as a guest OS 
was easier than installing Linux on a typ¬ 
ical PC, which may have nonstandard 
hardware devices. Because the VMware 
virtual devices do not necessarily corre¬ 
spond to physical devices (in terms of 
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(continued from page 74) 
brand, for instance), it is possible to run 
Linux on VMware on a machine with non¬ 
standard hardware that would have oth¬ 
erwise been unsupported by Linux. 

To simplify the administration of mul¬ 
tiple machines, the VM configuration and 
guest OS installation were done once on 
a single machine to create a master sys¬ 
tem. The master was then distributed to 
the other machines using rdist file- 
distribution software. 

Experiences 

Students’ experiences with VMware were 
quite positive. Once VMware and the guest 
OS were installed, a user could simply turn 
on the guest machine by clicking on the 
Power On button in the VMware GUI. 
When running, the guest machine looks 
like a complete desktop computing envi¬ 
ronment running within a VMware win¬ 
dow on the host OS. In addition to this 
window mode of operation, full-screen 
mode for the guest OS is also available. 
Shutdown and reboot of the guest ma¬ 
chine also had the same look-and-feel of 
the host OS. A Power Off button turns the 
VMware system off in the same way that 
it does on normal hardware. Students 
found VMware easy and intuitive to use. 

One feature students found quite use¬ 
ful was the ability to launch and use 
VMware from a remote machine. When 
used in window mode, VMware runs es¬ 
sentially like a normal X application un¬ 
der Linux, so it can be run such that the 
VMware GUI is displayed on another ma¬ 
chine. Consequently, students did not have 
to compete for console access to use 
VMware. We also gave students who want¬ 
ed remote-access functionality the option 
of using the X version of VNC, a thin-client 
software system developed by AT&T re¬ 
search. VNC (http://www.uk.research 
.att.com/vnc/download.html) provides 
screen-sharing technology so that users 
can see and control the exact same screen 
on multiple machines, which made it much 
easier for students to collaborate in their 
project groups. In addition, we found that 
VNC could be used by a number of dis¬ 
tance learning and off-campus students in 
the industry who could not access VMware 
using X because of corporate firewalls. 

In some cases, there were problems 
with using VMware together with VNC be¬ 
cause of limitations in VNC’s X protocol 
support. However, the combination of the 
two was robust enough that a distance¬ 
learning student in Japan was able to suc¬ 
cessfully collaborate with local students 
on their group assignments using the 
VMware/VNC system. Some remote users 
did have an initial problem using VMware 
remotely in which keystrokes would re¬ 
peat randomly. Linux defines a keyboard 
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delay time that determines the amount of 
time that a key must be pressed before it 
will start to repeat. The keyboard delay 
time can be changed using the Linux kbd- 
rate command, and this can be done with 
the OS boot up by including the kbdrate 
command in the rc.local file. In most cas¬ 
es, increasing the keyboard delay time of 
the guest Linux OS from the Linux default 
value to its maximum value completely 
eliminated the unwanted repeating 
keystrokes. 

A limitation of X and VNC is that they 
do not perform well over low-bandwidth 
connections such as modems. Students 
who only had low-bandwidth network 
access found the ability to Telnet to the 
running guest OS from the host OS to be 
useful. These students were still able to 
do project work through a Telnet win¬ 
dow. However, VMware and the guest 
OS have to already be running for the 
students to Telnet to the guest OS. It is 
not currently possible to run VMware and 
start up the guest OS without running 
the VMware GUI and clicking the Pow¬ 
er On button. As a result, Telnet users 
had to rely on other users with fast 
enough network connections to power 
up and shut down the VM. A VMware 
feature to allow users to start up a VM 
and guest OS configuration without us¬ 
ing the GUI would have been useful for 
the class. We discussed this with VMware 
and the company will provide this op¬ 
tion in future releases. 

A limitation of the version of VMware 
that we used was the lack of shrinkable 
virtual disks. Removing files from within 
a virtual disk in a guest OS did not cause 
the file image on the host OS to shrink. 
Students ran into problems with this when 
using an undoable virtual disk and com¬ 
mitting changes at the end of a session to 
the virtual disk. The undoable disk option 
creates log files of disk changes that are 
not saved to disk until they are commit¬ 
ted by users. If the log files were large 
enough, a commit operation could cause 
the host OS disk partition to run out of 
space, which would in turn leave the guest 
OS disk in an inconsistent state. Since the 
host OS disk partitions only had about 100 
MB of extra space after the guest OS was 
installed, some students ended up running 
out of space and crashing their virtual 
disks. Support for shrinkable virtual disks 
has since been added to the newer ver¬ 
sions of VMware. 

The most important features lacking in 
VMware for deploying it in a computer 
lab setting are easy-to-use system ad¬ 
ministration options. VMware does not 
support any features to let a system ad¬ 
ministrator limit how a user configures a 
VM. For our course, we made the VM con¬ 
figuration file read-only so that students 
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could not change it. However, students 
could simply create their own VM con¬ 
figuration files to bypass the ones we had 
provided. They could then change con¬ 
figuration settings, including access to the 
host machine’s floppy and CD-ROM drives, 
the amount of memory given to the guest 
OS, and even the network settings. Users 
with root access in a guest OS could find 
an unused IP address and enable bridged 
networking to become root on the IAJM. 
A workaround for this is to disable the 
bridge networking driver on the host ma¬ 
chine. Other undocumented workarounds 
also exist, but they are more complicat¬ 
ed. Simple nonoverridable configuration 
files would make a system administrator’s 
life much easier. In addition to VM con¬ 
figuration management limitations, we 
found the per-user licensing requirement 
more tedious to administer. We would 
have preferred a per-machine license in¬ 
stead of a per-user license. Instead of hav¬ 
ing to put a license in each user’s home 
directory, we would have preferred to sim¬ 
ply have a license associated with each 
host machine. 

While our use of only 16 MB of RAM 
per VM was less than ideal, we found that 
even then the performance of the VMs 
was reasonable. Compiling the entire Lin¬ 
ux kernel took about 12 minutes to do 
when running one compilation in one VM 
on a given machine. It took about 22 min¬ 
utes to do when mnning simultaneous 
compilations in both of the VMs on a giv¬ 
en machine. In contrast, compiling the Lin¬ 
ux kernel on the host OS with 128 MB of 
RAM took about 6 minutes. The biggest 
performance slowdowns when running in 
VMware are for operations that make 
heavy use of kernel code, such as during 
boot up and shutdown. In general, the 
overall performance we have observed 
has been quite reasonable. VMware has 
said that the performance is even better 
for newer versions of the software. 

Conclusion 

We found VMware to be an excellent tool 
for creating kernel-development environ¬ 
ments for students to leam about operating- 
system design and implementation. We 
have since upgraded to VMware 2.0 and 
are using it for both the introductory and 
advanced operating-systems classes taught 
at Columbia University. We believe that 
VMware can be used effectively in other 
teaching environments where multiple op¬ 
erating systems, kernel-level access, and 
fault isolation are needed. Anecdotal ev¬ 
idence leads us to believe that students 
enjoyed their experience using Linux and 
VMware. 
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T his is the third in a series of articles 
on decoding IEEE 1394 configuration 
ROMs. In the first article, “IEEE 1394 
Configuration ROM Decoder” (DDJ, 
August 1999), I discussed how to read 
and decode the configuration ROM of 
1394 peripherals on Windows 95 using 
the TI TSBKPCI 1394 controller and TI 
LynxSoft drivers. In the second article, “A 
WDM IEEE 1394 Configuration ROM De¬ 
coder” ( DDJ , December 1999), I present¬ 
ed a port of the Windows 95 DumpRom 
program into the Windows 98/2000 WDM 
architecture. In this article, I’ll present the 
implementation of the DumpRom program 
under Linux using an OHCI 1394 controller. 
The source code and related files that im¬ 
plement this utility are available electron¬ 
ically; see “Resource Center,” page 5. 

IEEE 1394 and Linux 

Currently, Linux has no official 1394 de¬ 
vice architecture. However, there is an on¬ 
going 1394 Linux project (see http://eclipt 


Bill is a senior software engineer at LSI 
Logic (formerly Symbios Logic). His cur¬ 
rent responsibilities include developing 
1394 device driven, software, and utili¬ 
ties. He can be contacted at http://www 
.geocities.com/BillAlexander/. 


.uni-klu.ac.at/ieeel394). The lack of an 
official interface creates a void that some 
programmers crave—a virtually un¬ 
touched frontier in which to explore. No 
driver stack to get in your way, no dog¬ 
matic architecture to limit possibilities, and 
no existing API to make life a little easi¬ 
er. In short, roll your own driver and ap¬ 
plication. 



As Table 1 shows, the DumpRom util¬ 
ity for Linux consists of four files. The 
ohci.o file is a module driver that sets up 
the OHCI 1394 adapter resources, allo¬ 
cates system memory, and initializes the 
low-level interface. The ohcitest file is a 
user-level program that loads ohci.o, then 
maps the OHCI register space and DMA 
space into process memory space in or¬ 
der to manipulate the hardware directly. 
It also provides an interactive command 
interface for the user to perform certain 
operations on the hardware and the 1394 


bus. The dodumprom file is intended to 
be redirected as the standard input of 
ohcitest to perform the operations need¬ 
ed to decode the configuration ROM of 
device 0. The dumprom file is a shell script 
that executes the program. 

The OHCI Module Driver 

The ohci.o file is a module driver that can 
be loaded and unloaded dynamically. Un¬ 
der Linux, only the root user can load and 
unload modules using the insmod (install 
module) and rmmod (remove module) 
commands, respectively. Once ohci.o is 
loaded, Linux calls the initjnoduleO rou¬ 
tine, which then calls device_init(). The 
main responsibilities of device JnitO are: 

1. Read the resources (that is, vendor ID, de¬ 
vice ID, IRQ number, and memory base 
address) assigned to the card by PCI. 

2. Allocate DMA memory. 

3. Map DMA memory. 

4. Map the OHCI register memory. 

5. Set up the interrupt handler. 

6. Register the logical OHCI register and 
OHCI DMA devices with the kernel as 
a character driver. 

Because ohci.o is a “do nothing” driv¬ 
er, the most important service deviceJnitO 
renders is mapping the register and DMA 
memory spaces. This lets an application 
map these spaces into its local memory 
and manipulate the OHCI registers and 
DMA structures directly. The driver does 
not attempt to assert any control over the 
hardware. 

Both memory spaces have a logical de¬ 
vice wrapped around them. When the 
ohci.o module registers with the kernel, 
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(continued from page 80) 
it actually registers two logical devices. 
The first logical device is the OHCI regis¬ 
ter device. The second is the OHCI DMA 
device. Through the use of the open() 
and mmapO functions, an application can 
call the driver to map these logical device 
memories into local memory space. 

The Ohcitest Program 

The ohcitest application serves two func¬ 
tions. First, it controls the OHCI adapter 
hardware. It does this through the regis¬ 
ter and DMA memory spaces that are 
mapped from the driver to the local mem¬ 
ory space. To achieve this, ohcitest first 
loads the module ohci.o and then uses 
mknod to create “special files” \dev\ohciO 
and \dev\ohcil. Each of these files cor¬ 
responds to the logical OHCI and DMA 
devices registered by the driver. The spe¬ 
cial file \dev\ohcil corresponds to the 
OHCI register driver and \dev\ohcil cor¬ 
responds to the OHCI DMA driver. Ohci¬ 
test calls open() on each of these special 
files to open the interface to the logical 
devices. Using the handles returned by 
open (), ohcitest next calls mmap() to map 
the respective memory spaces into local 
space. 

Ohcitest uses the register space to ini¬ 
tiate 1394 packet transmissions and re¬ 
ceptions. The DMA memory is where the 
actual 1394 packets reside. When a pack¬ 
et is to be transmitted, the program cre¬ 
ates the packet in the DMA memory, 
points the transmit DMA register to it, and 
then starts the transmit DMA. When a 
packet is to be received, the program 
points the receive DMA register to DMA 
memory, starts the receive DMA, and waits 
until a packet arrives. 

After the memories have been mapped, 
ohcitest spawns a process to monitor the 
interaipt register. It does this through the 
EventProcessO routine, which is nothing 
more than a large loop that examines the 
OHCI IntEvent register. If any bits are set, 
it processes the events one at a time. Af¬ 
ter all events are processed, the loop starts 
all over. After so many iterations through 
the loop without processing any events, 
the child process puts itself to sleep for a 
short time so that the main process can 
run. This is important because the child 
process runs at a slightly higher priority 
than the main process. Without putting it¬ 


self to sleep, the child process would pre¬ 
vent the main process from running. 

The second function that ohcitest pro¬ 
vides is an interactive user interface. Af¬ 
ter starting the child process, ohcitest dis¬ 
plays a prompt for users to manually input 
commands. The commands that are need¬ 
ed to decode a configuration ROM are: 
InitCard, BusReset , DumpRom <node 
number>, and Quit. The InitCard com¬ 
mand causes the InitCardO routine to be 
called. This routine resets the OHCI 
adapter and gets it ready for normal op¬ 
eration. However, InitCardO does not 
enumerate the devices on the bus. This is 
the job of the BusReset command. When 


Currently, Linux has 
no official 1394 
device architecture 


BusReset is issued, the BusResetO routine 
is executed. BusResetO resets the 1394 
bus and then waits for EventProcessO to 
receive the self ID packets generated by 
all of the nodes on the bus. Once the 
topology map of all devices on the bus 
has been created, BusResetO returns. 

When the OHCI adapter is ready, the 
DumpRom command can be issued. The 
node number of die target device is spec¬ 
ified on the command line. For example, 
the command DumpRom 0 causes the 
configuration ROM of node 0 to be 
dumped and decoded. The first thing the 
DumpRom command does is call Read- 
ConfigRomO. This reads the entire con¬ 
figuration ROM from the specified device 
and places it into a buffer. Next, the 
DumpConfigRomO routine is called, 
which displays the contents of the buffer 
in raw hexadecimal quadlets. Last, Dump¬ 
Rom calls DecodeConJigRomO , which de¬ 


codes the buffer according to the 1394 
specifications. 

The Quit command exits the ohcitest 
program. The OHCI board is reset, all 
structures are deallocated, and the driver 
is unloaded. 

Running the Program 

Before running the ohcitest program, you 
need to log in as root. The reason for 
this is that ohcitest will first attempt to 
install the ohci.o module via the Linux 
insmod command. Only the root user 
has privileges to run the insmod com¬ 
mand. Some UNIX and Linux veterans 
will reel back in horror at the thought 
of a program calling root commands 
such as insmod , but this is an initial de¬ 
velopment tool intended for rapid 
changes in both the driver and the pro¬ 
gram. If you start your 1394 development 
with this source, you will grow to ap¬ 
preciate the speed at which you can 
change and reload the driver using this 
method. 

Once you are logged in as root, you can 
run the ohcitest program manually. How¬ 
ever, you must enter the InitCard , BusRe¬ 
set , DumpRom , and Quit commands your¬ 
self. To make things easier, I’ve provided 
a shell script that will automatically de¬ 
code the configuration ROM of node 0. 
The dumprom script: 

./ohcitest < dodumprom 

As you can see, DumpRom redirects the 
standard input of ohcitest with the do¬ 
dumprom file. The dodumprom file is noth¬ 
ing more than the commands you need: 

initcard 

busreset 

dumprom 0 

q 

When the DumpRom shell script is ex¬ 
ecuted, the output is similar to the two 
previous versions of my utility. If I plug 
in a Sony CCM-DS250 1394 camera and 
run the script, the result is Listing One. 

Conclusion 

The Linux version of DumpRom is an ex¬ 
cellent place to start 1394 development. It 
provides the means to experiment. Unlike 
Windows 2000, you have raw, direct ac¬ 
cess to the hardware, which has many ad¬ 
vantages to developers like myself. On the 
other hand, if you don’t want to wade 
through the details of programming the 
OHCI card directly, you might want to 
start with the latest code from Emanuel 
Pirker’s Linux IEEE 1394 Subsystem web 
page at http://eclipt.uni-klu.ac.at/ieeel394. 


DDJ 

(Listing begins on page 84.) 


File Name 

Description 

ohci.o 

Module driver that sets up interface to hardware. 

ohcitest 

Program that does most of the work. 

dodumprom 

File to be redirected as standard input. 

dumprom 

Shell script to run the utility. 


Table 1: Files that make up the Linux DumpRom utility. 
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Listing One 

OHCI Register Memory Map = 40014800 

OHCI DMA Mezory Map = 40017000 

OHCI DMA Mezory Physical Address = 00E3A000 

**************** event occurred ***************** 

Event = busReset 
tizeStazp = 000000A0 
selfIDGeneration = 00000001 

0 40017004 phy.ID 00.L l.gap_cnt 3F,sp l.del 0.c 0.pwr 6,p0 l.pl l.p2 2 
1 4001700C phy_ID 01.L l.gap.cnt 00.sp 2.del 0.c 0,pwr 4,p0 3.pi l,p2 1 
**************** EVENT OCCURRED ***************** 

Event = phyRegRcvd 

**************** EVENT OCCURRED ***************** 

Event = selfIDComplete 

**************** EVENT OCCURRED ***************** 

Event = RSPkt 

**************** EVENT OCCURRED ***************** 

Event = RSPkt 

**************** event occurred ***************** 

Event = RSPkt 

**************** EVENT OCCURRED ***************** 

Event = RSPkt 

OHCI Register Memory Map = 40014800 

OHCI DMA Memory Map = 40017000 

OHCI DMA Mezory Physical Address = 00E3A000 

Raw Data Dump of the Configuration ROM 


1394 Addr Off Data 


FFFF:F0000400 

041F40AA 

31333934 

20FF4000 

08004602 

FFFF:F0000410 

000003BD 

0004C80A 

03080046 

0C0083C0 

FFFF:F0000420 

8D000002 

D1000004 

00029E8D 

08004602 

FFFF:F0000430 

000003BD 

0003D7FE 

1200A02D 

13000100 

FFFF:F0000440 

D4000001 

00034FEA 

403C0000 

81000002 

FFFF:F0000450 

82000005 

00033A64 

00000000 

00000000 

FFFF:F0000460 

534F4E59 

0006010B 

00000000 

00000000 

FFFF:F0000470 

43434D2D 

44533235 

3020312E 

30380000 


Decode of the Configuration ROM 
1394 Addr Off Quadlet Meaning 


Confiruation ROM Header 

FFFF:F0000400 041F40AA info_length=04. crc_length=lF, rom_crc_value=40AA 
Bus_Info_Block 

FFFF:F0C00404 31333934 bus_name=31333934 (”1394") 

FFFF:F0000408 20FF4000 irmc=0, cmc=0, isc=l, bmc=0, cyc_clk_acc=FF, max_rec=4 
FFFF:F000040C 08004602 node_vendor_id=080046, chip_id_hi=02 
FFFF:F0000410 000003BD chip_id_lo=000003BD 


Root_Directory 

FFFF:F0000414 0004C80A length=0004. crc=C80A 

FFFF:F0000418 03080046 Module.Vendor.Id 080046 

FFFF:F000041C 0C0083C0 Node.Capabilities spt 64 fix 1st drg 

FFFF:F0000420 8D000002 Node.Unique.Id leaf ind_off=000002 (FFFF:F0000428) 

FFFF:F0000424 D1000004 Unit.Directory directory ind_off=000004 (FFFF:F0000434) 

Node_Unique_Id leaf referenced from FFFF:F0000420 
FFFF:F0000428 00029E8D length=0002. crc=9E8D 
FFFF:F000042C 08004602 ..F. 

FFFF:F0000430 000003BD .... 

Unit.Directory directory referenced from FFFF:F0000424 
FFFF:F0000434 0003D7FE length=0003. crc=D7FE 
FFFF:F0000438 1200A02D Unit.Spec.Id 00A02D 
FFFF:F000043C 13000100 Unit.Sw_Version 000100 
FFFF:F0000440 D4000001 Unit.Dependent.Info directory 

ind.off=000001 (FFFF:F0000444) 

Unit.Dependent.Info directory referenced from FFFF:F0000440 
FFFF:F0000444 00034FEA length=0003. crc=4FEA 

FFFF:F0000448 403C0000 key=40 (UNKNOWN) crc_offset=3C0000 (FFFF:F0F00000) 
FFFF-.F000044C 81000002 Textual.Descriptor leaf ind_off=000002 (FFFF:F0000454) 
FFFF:F0000450 82000005 Bus.Dependent.Info leaf ind.off=000005 (FFFF:F0000464) 

Textual.Descriptor leaf referenced from FFFF:F000044C 
FFFF:F0000454 00033A64 length=0003. crc=3A64 
FFFF:F0000458 00000000 .... 

FFFF:F000045C 00000000 .... 

FFFF:F0000460 534F4E59 SONY 

Bus.Dependent.Info leaf referenced from FFFF:F0000450 
FFFF:F0000464 0006010B length=0006. crc=010B 
FFFF:F0000468 00000000 .... 

FFFF:F000046C 00000000 .... 

FFFF:F0000470 43434D2D CCM- 
FFFF:F0000474 44533235 DS25 
FFFF:F0000478 3020312E 0 1. 

FFFF:F000047C 30380000 08.. 


DDJ 
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& Embedded 
Networks 


A new method for 
ensuring reliable 
communication 

H. Thomas Richter 

T here’s no question that reliable com¬ 
munication is a fundamental re¬ 
quirement of all networks. Nor is the 
situation any different when it comes 
to networks with embedded processors. 
In fact, the reliability requirements for 
embedded networks, where a human op¬ 
erator isn’t available to monitor the sys¬ 
tem or a life-threatening situation can oc¬ 
cur if the network crashes, can be even 
more critical than those for nonembed- 
ded networks. In this article, I present a 
new method for ensuring reliable com¬ 
munication between hosts in small net¬ 
worked environments. I am currently us- 


Thomas is a systems programmer at IBM 
Boblingen (Germany). He can be con¬ 
tacted at tmncht@de.ibm.com. 
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ing this method on a system based on an 
IBM PowerPC 403GCX and two Nation¬ 
al Semiconductor NS 83905 10-Mbps Eth¬ 
ernet chips running on OS Open, which 
is a real-time operating system from IBM. 
Applications use the BSD4.3.2 Reno 



TCP/IP implementation for communica¬ 
tion. No application change whatsoever 
is needed to use the new features intro¬ 
duced in this article. The switch of the 
physical network is transparent to the 
TCP/IP stack built into the operating sys- 

Dr. Dobb’sJournal, August 2000 


tern and is handled by the Ethernet de¬ 
vice driver. Since this is a software solu¬ 
tion, all existing hardware can be reused. 
The complete source code—enetlib.h, 
enetswap.h, and enetlib.c — for the de¬ 
vice driver is available electronically; see 
“Resource Center,” page 5. 

When implementing the techniques pre¬ 
sented here, I had three general design 
goals: 

• No changes to the application code. 
Applications should run unchanged on 
this network infrastructure and remain 
unaware of faulty interfaces or net¬ 
works. 

• No (or at least minimal) code changes 
to the TCP/IP implementation. 

• No disruption and no loss of data for 
existing TCP connections. 

More specifically, two innovations made 
it possible for me to achieve these design 
goals and still maintain a high level of re¬ 
liability: 

• A new device-driver structure, in which 
one device driver handles both inter¬ 
faces as one single unit and hides one 
interface from the TCP/IP layer. 

• The development of the swap message 

http://www. ddj. com 
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(continued from page 86) 
as a new message type beside IP and 
ARP packets. 

For instance, Figure 1 shows two sep¬ 
arate Ethernet networks. (Of course, the 
network can connect more than two sys¬ 
tems.) If a network hardware problem 
on one communication path (a broken 


cable, bad Ethernet controller, faulty hub, 
or the like) occurs, the other network 
path can be switched to very quickly, 
without loss of any data. In such in¬ 
stances, the software chooses an alter¬ 
nate path to the destination with mini¬ 
mal delay and disruption. 

Hosts with several network interface 
devices are called “multihomed.” Each 


network device operates independently 
and has its own IP address and network 
mask. Routing tables decide which in¬ 
terface to use to reach the destination. 
When one interface goes out of service, 
all hosts on the network are unreach¬ 
able. Routing information can be dy¬ 
namically generated and propagated 
throughout the network to tell each host 
that a host or network just went out of 
service. RIP or RIP-2 (see IP Routing Fun¬ 
damentals, by Mark Sportack, Cisco 
Press, 1999) and the routed daemon (see 
TCP/IP Illustrated, Volume I, by Richard 
Stevens, Addison-Wesley, 1994) are well- 
known protocols and programs for this 
task. However, it takes time to notify all 
hosts of the new situation and such over¬ 
head is unnecessary in a LAN environ¬ 
ment. My approach eliminates this time 
lag and, of course, it is designed specif¬ 
ically for the needs of embedded 
systems. 

Ethernet Device-Driver Modifications 

To handle both network interfaces, I 
modified the Ethernet device driver. Be¬ 
cause embedded systems have no local 
disk, the initial program is loaded via 
bootstrap and FTP, which are pro¬ 
grammed into flash memory. Each em¬ 
bedded system receives its program and 



Figure 1: Network topology . 
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(continued from page 88) 

IP address from a control station, which 
acts as the boot server and is connected 
to both networks. It then initializes both 
Ethernet interfaces for send/receive. 
However, only one (Device 0, for ex¬ 
ample) is actually attached to the TCP/IP 
stack and used for communication. This 
means only one TCP/IP interface is up 


and running and only one IP address 
and network mask is used for both Eth¬ 
ernet devices. 

Since all embedded systems in this kind 
of network are built the same way using 
core+asic chips, Device 0 always refers to 
the same network interface; in this case, 
Network 1. After loading die software and 
initializing the hardware components, the 



Try 1 

Try 2 

Try 3 

Average 

Without network switch 

3.6 

3.7 

3.9 

3.733 

Sender triggered network switch 

4.34 

4.11 

4.23 

4.226 

Receiver triggered network switch 

4.35 

4.11 

4.37 

4.276 

Both triggered network switch 
(hub failure) 

4.34 

4.35 

4.37 

4.353 


Table 1: Performance impact timings (in seconds). 



Figure 2: Embedded network after initialization. 



Figure 3: Embedded network after network switch. 
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(continued from page 90) 
embedded systems now communicate 
with each other and the control station 
over Network 1, the primary network. Net¬ 
work 2 is referred to as the “backup net¬ 
work.” As long as there are no network 
failures on Network 1, the device driver 
handles Ethernet traffic like any other net¬ 
work device driver. 

To detea physical network problems, the 
device driver monitors the conneaion be¬ 
tween each network interface and the hub 
(although I used Ethernet lOBaseT with a 
RJ45 connector, almost any device offers 
hardware support to query a connection to 
the hub). If the physical connection goes 
down, the device driver acts depending on 
the state of the failing network: 

• If the failing connection belongs to the 
backup network, no action is needed. 
The communication continues to use 
the primary network. 

• If the failing connection belongs to the 
primary network, immediate action is 
required. Communication continues on 
the backup network and the embedded 
system notifies the control station to 
record the error. 

If any device driver detects a broken 
physical link from its primary network 


interface device to the hub, the backup 
network is made the new primary net¬ 
work. The device driver detecting a fault 
broadcasts a special message, called 
“swap message,” on the backup network. 
(The device has been initialized at start¬ 
up time and is fully operational.) The 
broadcast of the swap message is need¬ 
ed to notify all other device drivers in 
the network to shut down the primary 
network and use the backup network 
from this point forward. The switch takes 
place immediately after a driver receives 
such a swap message. The swap mes¬ 
sage consists of: 

• A 6-byte Ethernet destination address. 
Since the message is sent via broadcast, 
all bits in the field are set to 1. 

• A 6-byte Ethernet source address. This 
is the MAC layer address of the send¬ 
ing Ethernet device. This address is 
unique for each device. 

• A 2-byte Ethernet type field with the 
value of 0x0805. Other valid values are 
0x0800 for IP packets and 0x0806 for 
ARP packets. 

• A 1-byte command field with the value 
of 1 for S\VAP_NETWORK. 

• A 1-byte field that denotes the Ethernet 
device number to use from this point 
on. Since each embedded system has 


only two built-in Ethernet devices, the 

value can only be 0 or 1. 

The swap message is an OSI Layer 3 pro¬ 
tocol. No provisions are made to retransmit 
or acknowledge swap messages. Retrans¬ 
mission of swap messages is not considered 
important because the projea uses only a 
small LAN contained in a single segment. 
Acknowledgment of swap messages is dif¬ 
ficult to implement and causes a lot of over¬ 
head because the amount of hosts in a net¬ 
work may vary. If a device driver misses a 
swap message, the host is unreachable. 

If the swap message comes in on the 
primary network, it is quietly discarded. 
Why? Because this embedded system has 
already swapped networks. Consequent¬ 
ly, any incoming messages on the back¬ 
up network that are not swap messages 
are ignored. 

The way the physical state of the con¬ 
nection is checked depends on the Eth¬ 
ernet device. Some devices generate an 
interrupt when the carrier signal drops. 
Other devices require a periodic check in 
very short intervals (every 100 millisec¬ 
onds, for example) of corresponding hard¬ 
ware registers. 

The control station can record the net¬ 
work switch and trigger repair actions to 
replace the faulty part. 
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(continued from page 92) 

While programs use TCP/IP address¬ 
es to send data to the destination, the 
Ethernet devices use unique MAC ad¬ 
dresses. The Address Resolution Proto¬ 
col (ARP) on the device-driver level is 
used to find out which TCP/IP address 
belongs to which machine and what that 
machine’s MAC address is. Once a map¬ 
ping from TCP/IP address to MAC ad¬ 
dress has been determined, it is stored 
by TCP/IP software. ARP is a funda¬ 
mental part of the TCP/IP protocol suite 
and has been explained by both Richard 
Stevens and Gary Wright in TCP/IP Il¬ 
lustrated, Volume II (Addison-Wesley, 
1995) and Douglas Comer in Internet¬ 
working with TCP/IP, Volume I (Prentice 
Hall, 1986). 

After a device driver has either sent 
or received the swap message, every 
host uses the alternate (backup) Ethernet 
device. Therefore, all accumulated 
TCP/IP-to-MAC address translations are 
now invalid and the ARP table is com¬ 
pletely flushed as soon as such a mes¬ 
sage is sent or received on the backup 
network. 

The procedure to swap physical net¬ 
works is: 

1. After boot and initialization, each em¬ 
bedded system uses the Device 0 and 
Network 1. The embedded system’s 
IP address and network mask, as¬ 
signed at boot phase, are connected 
to Device 0. Device 1 is initialized and 
ready to use. Device 0 ignores in¬ 
coming swap messages and passes in¬ 
coming packets to the TCP/IP stack 
or to ARP processing, depending on 
the packet type. Device 1 ignores all 
packets except for swap messages; it 
is the passive or quiet interface (see 
Figure 2). 

2. After some time, the Ethernet device 
driver on embedded system PPC 1 de¬ 
tects a failing link between its active 
network device and the hub. It broad¬ 
casts a swap message on the passive 
Ethernet Device 1 and flushes the ARP 
table. The Device 0 is now dead, the 
device driver ignores all type of pack¬ 
ets coming in on this device and does 
not send any packet on it. 

The Ethernet device driver on em¬ 
bedded system PPC 2 receives the swap 
message on Device 1. It also flushes the 
ARP tables, ignores all types of pack¬ 
ets coming in on Device 0, and does 
not send any packet on Device 0; see 
Figure 3. 

3. If a TCP connection was active dur¬ 
ing the network switch, the sending 
side (PPC 1, for example) waits for an 
acknowledgment (ACK) packet. If this 
packet does not arrive in time, the 
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(continued from page 94) 

sender retransmits the data. The de¬ 
vice driver now sends this packet over 
Device 1. As the MAC address of the 
destination is not available, the ARP 
table has been flushed, the driver 
sends an ARP request packet over Net¬ 
work 2 to learn the MAC address of 
the now-active Ethernet Device 1 on 
target system PPC 2. 

The receiver acts in the same way. 
It has to acknowledge received data 
and sends ACK packets. The device 
driver has to send these packets over 
a new device, Ethernet Device 1. Be¬ 
cause of the flushed ARP table, an ARP 
request is generated to learn the re¬ 
cipient’s MAC address. 

If a network switch occurs during 
an active TCP connection, the addi¬ 
tional overhead is one or two ARP re¬ 
quests and response packets, and the 
time needed to detect the bad link. 
When a link failure does not trigger 
an interrupt, the device driver has to 
query to link status periodically. The 
intervals must be shorter than the TCP 
retransmission timeouts. The current 
value is 100 milliseconds. 

Even though UDP and ICMP pro¬ 
tocols are by nature unreliable, I make 
no provisions to prevent these packets 


from getting lost. It’s up to the appli¬ 
cation to ensure reliability. This is also 
the case for traditional single network 
attachments. Swap messages and net¬ 
work switching introduce no new 
problems. 

Performance 

To check die performance of diis approach, 
I used the sock program (see TCP/IP Il¬ 
lustrated, Volume I, by Richard Stevens, Ad- 
dison-Wesley, 1994) to monitor the impact 
of when network switches occur. I set bodi 
the sender and receiver buffers to 16,384 
bytes, using the command-line flags -R 
and -S. During an active TCP connection, 
data is sent from sender to receiver and 
the receive side acknowledges the data. 
Table 1 lists the results in seconds and 
milliseconds. 

Conclusion 

Although the communication technique 
presented here has proven to be high¬ 
ly reliable in embedded networks, fur¬ 
ther work is still needed to overcome 
some limitations of the current imple¬ 
mentation: 

• A more robust swap-message protocol. 
Currently, a missed swap message leads 
to an unreachable host. As a quick 


workaround, I send the swap message 
several times. 

• Utilize both networks for increased 
bandwidth and network throughput 
and fall back to one network in case 
of failure. However, this requires 
changes in TCP/IP’s ARP handling, as 
there will be several MAC addresses 
for one IP address. Since this violated 
other design goals (not to change 
TCP/IP stack) it was deferred. 
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INTERNET PROGRAMMING 


DB Forms: 
PHP, MySQL, 
and PHPLIB 


A reusable database 
frameworkfor 
writing web apps 

Darryl Ross and Con Zymaris 

HP is a server-side web scripting sys¬ 
tem. Although initially developed by 
Rasmus Lerdorf, it is now maintained 
by a world-wide group of open- 
source coders. PHP is powerful enough 
to make Perl or C coders feel at home, 
yet it has a syntax simple enough for Vi¬ 
sual Basic programmers to quickly get up 
to speed. In this article, well examine PHP, 
as well as the MySQL database engine and 
PHPLIB class framework. To illustrate how 
you use these tools, well then present DB 
Forms, a reusable database framework for 
writing web applications. 

PHP 

The PHP (http://www.php.net/) engine 
can be invoked as either a CGI-callable 


Darryl is a senior ivebprogrammer, and Con 
the CEO of Cybersource ; an open source fr 
company based in Melbourne, Australia. 7Jxy 
can lx contacted at djr@cylxr.com.au and 
conz@cyber.com.au, respectively. 
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interpreter from supported UNIX platforms 
(its most common OS platform is Linux) 
and Windows NT, or as an in-process 
Apache module. PHP scripts, such as ASP 
or Java Server Pages, are embedded with¬ 
in HTML Files served up by the web serv¬ 
er. In turn, the embedded PHP code is ex¬ 
ecuted by the PHP interpreter and any 



printfOs it writes are incorporated into 
the outgoing HTTP stream from web serv¬ 
er to browser. Thus, with PHP, you de¬ 
velop applications that can be viewed by 
all HTML-capable browsers. 

PHP’s syntax can be described as a 
cross between C, Perl, and shell, and by 
most accounts, is easier to learn than, 
say, ASP, Python, JSP, or Perl. It also has 

Dr. Dobb’s Journal, August 2000 


a wealth of functions—over 700 and 
counting (see Table 1). Like many script¬ 
ing languages, PHP is typeless, and vari¬ 
able type is decided by the interpreter 
at run time. PHP also offers object- 
oriented capabilities. Classes can incor¬ 
porate variables and functions, have con¬ 
structors, and can be derived and ex¬ 
tended. PHP’s arrays are powerful, and 
can act as associative arrays (hash ta¬ 
bles) and standard indexed arrays. PHP 
arrays also hold data of different types 
and can be nested to arbitrary levels. 
Thus, you can use them to build com¬ 
plex data structures (similar to a C 
struct). There are also numerous func¬ 
tions for manipulating arrays and step¬ 
ping through the data. 

Listing One is a typical PHP script. The 
HTML “baggage” can be removed to re¬ 
veal the “active element” in the script, 
which is: 

<? echo “Hello World! (When you’re on a 
good thing...)”; ?> 

As with other web-scripting systems 
embedded in HTML, PHP code needs to 
be clearly denoted to the interpreter. In 
this case, PHP scripts are enclosed with¬ 
in the <? and ?> brackets, respectively. 

PHP has extensive native support for 
most SQL databases (see Table 2), as 
well as for all ODBC-compliant databas¬ 
es. PHP also offers persistent database 
connections, which reduce the overhead 
required to undertake database work. A 

http://www. ddj. com 
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(continued from page 98) 
connection to your database needs to be 
opened only once; this connection is then 
shared between die various PHP processes 
that handle the incoming web requests. 
Since many database authentication and 
handshake negotiations take time, this 
helps ensure timely data delivery to users. 
Further, the feature has been designed to 
be drop-in replaceable for nonpersistent 
connections, without substantial changes 
to your scripts. 

PHP Version 4 provides numerous im¬ 
provements over previous versions, the 
most important being (from the perspec¬ 
tive of most users) the speed improve¬ 
ment in script execution delivered by the 
Zend (http://www.zend.com/) engine core 
within PI IP4. Reports of speed increases 
of up to an order of magnitude have l>een 
seen for some scripts. Almost full com¬ 
patibility is claimed by the PHP develop¬ 
ment group for existing scripts. On NT, 
PHP 4 supports integration with Ac- 
tiveX/COM objects. 

MySQL 

The database most often used with PHP 
is MySQL (http://www.mysql.com/), which 
is popular for a number of reasons. MySQL 
is perhaps the fastest general-purpose SQL- 
enabled RDBMS. It is also easy to install 


Apache Specific 

Arbitrary Precision Mathematics 

Array 

Aspell 

Calendar 

ClibPDF 

Compression 

Date and Time 

Directory 

Dynamic Loading 

Encryption 

Forms Data Format 

FTP 

Hash 

HTTP 

Hyperwave 

Image 

IMAP 

LDAP 

Mail 

Mathematical 
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Network 

NIS 

PDF 

Perl-Compatible Regular Expression 
PHP options and information 
POSIX 

Program Execution 

GNU Recode 
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Semaphore and Shared Memory 

Session Handling 

SNMP 

Vmailmgr 

WDDX 

XML Parser 


Table 1: PHP function groupings. 


and maintain. Of course, it does have some 
idiosyncrasies, such as a lack of transac¬ 
tions and database triggers. However, this 
is not as much a problem for web-based 
database work, where operations are con¬ 
siderably more atomic, and large volume 
batch transactions are rare. Another miss¬ 
ing feature is referential integrity, which, 
again is not a major problem if the web 
database is well designed. 

Unlike a pure open-source project, 
MySQL is accompanied by a variety of 
open and semiopen licenses. The MySQL 
developers seem to like the licensing mod¬ 
el pioneered by Ghostscript author, L. Pe¬ 
ter Deutsch, and follow a process of re¬ 
leasing older code under the GPL, while 
newer code is under a slightly more re¬ 
strictive license targeting revenue genera¬ 
tion from commercial bundling of MySQL. 

There are multiple methods and tools 
available to help create and maintain 
MySQL databases and metadata. To illus¬ 
trate, we’ll use the default method of the 
interactive command tool, mysqladmin. 
For instance, Example 1(a) creates a table, 
where the contents of example.sql would 
be listed in Example 1(b). Alternatively, 
you could run the mysql command-line 
client and type in the SQL directly. 

MySQL has a powerful (but unusual) 
method of user, host, and database priv¬ 
ileges. MySQL removes the concept of user 
access rights, introduces “user@host” ac¬ 
cess rights, and lets you assign SELECT, 
INSERT, UPDATE, DELETE, as well as 
bulk-insert privileges through the LOAD 
DATA IN FILE command. You can add 
users in two different ways: by using 
GRANT statements or manipulating the 
MySQL grant tables directly. The preferred 
method is to use GRANT statements, be- 


Adabas D functions 
Database (dbm-style) abstraction layer 
functions 
dBase functions 
dbm functions 
filePro functions 
Informix functions 
InterBase functions 
Microsoft SQL Server functions 
mSQL functions 
MySQL functions 
ODBC functions 
Oracle functions 
Oracle 8 functions 
PostgreSQL functions 
Program Execution functions 
Solid functions 
Sybase functions 


Table 2: PHP database interfaces. 


DBF_Edit 

DBF_Query 

DBF_FormEdit 

DBF_FormQuery 

Table 3: Main DB Forms classes. 
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cause they are more concise and less er¬ 
ror prone. 

Example 2 shows how to create a user 
webiiser , who has SELECT, DELETE, IN¬ 
SERT, and UPDATE privileges on the ad¬ 
dress table in the test database, using the 
password testing. 

Once you can create and maintain 
MySQL databases, you can move on to 
web-based (phpMyAdmin) or GUI-based 
(for both UNIX and Windows) tools. But 
before you move to the easy path of GUI 
tools, consider the power and importance 
of being proficient with the command-line 
toolset. This provides you with substantial 
advantages, such as the ability to SSH(l) 
into a remotely hosted server to rebuild or 
repair a database, which may not have any 
GUI tools installed. Example 1: (a) Creating a table; (b) contents of example.sql. 


PHPLIB and Web- 
Application Development 

Much application development with PHP 
and MySQL is done through the accumula¬ 
tion of numerous small, often self-contained 
scripts, with each script corresponding to a 
web page of output or data input. The uni¬ 
fying axle of these scripts is the data repos¬ 
itory, and classes are used to synchronize 
naming and function use for clarity, and to 
encourage code reuse. Thus, the schema of 
the underlying data forms almost a proto¬ 
col of discussion throughout the gaggle 
of scripts. One positive point about this 
style of development is that you can fo¬ 
cus on small, self-contained code units 
that are simple to understand and main¬ 
tain and which, in turn, increase the like¬ 
lihood of making them solid and reliable. 
This model also lends itself to clean ap¬ 
plication partitioning, possibly across sev¬ 
eral programmers. 

Boris Erdmann and Kristian Kuhntopp 
found that there were a number of re¬ 
quirements that all web-based apps need¬ 
ed that the base level of PHP3 didn’t pro¬ 
vide. They therefore set about building 
these components by way of an elegant 
class framework and called it PHPLIB 
(http://phplib.netuse.de/). Therein, they 
built provision for database independence, 
user and session management, and glob¬ 
al variables, thus overcoming the limita¬ 
tions of the stateless HTTP protocol. PHP- 
LIB’s extension of PHP’s database access 
is playing to one of PHP core strengths. 
While PHP can natively access most 
RDBMSs, the API calls differ between the 
different databases. PHPLIB provides a 
class-based generic wrapper for the dis¬ 
parate PHP DB API calls; see Listing Two. 

00H Forms 

PHPLIB developers have also added oth¬ 
er functionality such as object-oriented 
web-form elements. While many of us 
know how to create a web-based data en- 
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(a) 

mysql -u <user with create table privileges> <database> < <sql file> 
e.g. mysql -u root test < example.sql 

(b) 

create table address( 

name varchar(50) not null, 
address varchar(100), 
city varchar(50), 
state varchar(50), 
postcode int, 
phone varchar(20), 
fax varchar(20), 
email varchar(20), 
primary key(name) 

): 
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GRANT SELECT, DELETE, INSERT, UPDATE ON test.address TO webuser@localhost 
IDENTIFIED BY ’testing’; 

Example 2: Creating a 

user. 

Name 

Description 

classname 

Serialization helper: The name of this class. 

database_class 

A phplib class used to store and retrieve data. 

debug 

Set to true for generated sql to be displayed. 

checkjjpdates 

Set to true to enable checking of a timestamp field before 


updating. 

changedjield 

Name of field storing the last changed timestamp. 

userjield 

Name of field storing the name of the last user to update the 


record. 

changed 

Gets set to the last updated time. 

last_user 

Gets set to the last user. 


Table 4: DBF_Edit accessible instance variables. 
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professionals to deliver applications 
on time: no excuses. 


Omnis Studio is a powerful RAD 
tool that enhances your existing 
skills and lets you produce 
commercial applications in less 
time, keeping you ahead of the 
competition. You can develop 
once, and have a product that will 
run on Windows, Linux and 
Mac, as client/server or 
across the internet. You 
can interface with all the 
major databases such as 
Oracle, Sybase, Informix 
and DB2 or via ODBC. 


At just $149 for the complete 
suite of tools (including a VCS, an 
application builder, and full Web 
Client functionality) there's no 
better way to develop your 
business solution. Omnis also 
offers a comprehensive support 
program and the necessary 
training classes that will get 
you up and running 
quickly. If the clock is 
ticking, take time to 
discover the power of 
Omnis Studio. 



OMNIS 


Visit our web site or call 800-34-OMNIS (800-346-6647) 
and order your FREE evaluation copy of Omnis Studio now. 


www.omnis.net 


try form through the use of <BUTTON>- 
style markups, this isn’t the coding style 
that programmers prefer. Through OOH 
forms, you can create web forms using 
object-oriented nomenclature that in¬ 
cludes functionality such as text-entry 
validation based on powerful regular ex¬ 
pression matching (see Listing Three), 
which is much more programmer friend¬ 
ly than standard HTML element syntax. 

As an example of constructing a 
reusable framework for future PHP web 
apps, we present DB Forms—a collec¬ 
tion of PHP classes used to help build 
web-based user interfaces for relational 
databases. (The complete source code 
and related files for DB Forms are avail¬ 
able from DDJ , see “Resource Center,” 
page 5, and at ftp://ftp.cyber.com.au/ 
pub/cybertel/cyborg/db_forms.tar.gz.) 
The classes have been designed to inte¬ 
grate with PHPLIB and use the PHPLIB 
database and OOH Form classes. To use 
DB Forms, you need to have PHP, 
MySQL, and PHPLIB installed; then you 
simply place the DB Forms classes in the 
PHPLIB include path. DB Forms comes 
with four main classes; see Table 3. In 
essence, there are two sets of input and 
query classes—one set of classes that 
uses the PHPLIB OOH forms function¬ 
ality, and one that doesn’t. 

The class DBF_Edit generates queries 
to retrieve, save, and delete database 
records. DBFJEdit requires at least one 
key Field that uniquely identifies a record. 
One field can be of type auto (increment), 
in which case it should be the primary 
key. The externally accessible instance 
variables for this class are in Table 4. 

The class DBF_Query generates a SE¬ 
LECT query based on fields from one or 
more tables. If multiple tables are used, 
then foreign keys need to be supplied to 
generate links between tables. The query 
is built from PHP variables of the same 
name as the database fields. Any empty 
PHP variables are ignored in the query. If 
all variables are empty, then the query will 
not be executed. A URL can be supplied, 
which creates a hyperlink in the first col¬ 
umn of the tabulated output for each 
record found by the query. The values of 
the key fields will be appended to the URL 
query for each record. Table 5 lists the in¬ 
stance methods for this class. 

The source files that constitute the DB 
Forms framework are all .inc include files. 
To use these in your PHP project, enter 
include("dbfjsdit.inc'); in the appropri¬ 
ate file into your source file. You can then 
instantiate objects from the class; see List¬ 
ing Four. 

Another Example 

In the next example of a data edit form, 
several standard constructs of PHP and 
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Name 

Description 

init() 

Creates an instance of the DBF_Query object. 
Must be called first. 

add_table($table) 

Calls DBF_Query->add_table(). 

Change_table($table, $index=0) 

Calls DBF_Query->change_table(). 

add_field($field) 

Used to define a database field, addjield takes 
exactly one argument: an associate array 
whose key value pairs are used to define 
the field. 

array("type"=><type>, 

[,"optionaP’=>1], 

"name"=><fieldname>, [, "table"=> , ’<table>"] 
[OOH Form attributes]). 

addjield 

Strips out the relevant key values pairs and 
passes them to DBE_Query->addJield(). It 
then calls make_element() to build an 

OOH Form element. 

query() 

Calls DBF_Query->query(). 

show_results() 

Calls DBF_Query->show_results(). 


Table 5: Accessible instance methods. 


PHPLIB are obvious. Listing Five, the con¬ 
nection to the database, closely parallels 
the kinds of data that an ODBC connec¬ 
tion string would require. Further down, 
past die function and class definitions, List¬ 
ing Six instandates a database object of die 
type templated above. DB Forms works 
with the notion of there being a prima- 
ry_key } which it uses to bind data updates 
to. This has to be explicidy pointed out to 
the DBFJFonnEdit class, as in Listing Sev¬ 
en, and from there, the fields can all be 
extracted from the database widi code that 
looks like Listing Eight. 

Another point to note about this par¬ 
ticular script is that it is used to both pop¬ 
ulate the data entry form and to accept 
the updated data and refresh die database 
table. It does this through the if switch in 
Listing Nine. 

Conclusion 

We’ve presented the first step to building 
a generic web-based data-access system. 
It seems most plausible to take this part 
of a core end-user database system, cou¬ 
ple it with a web-based table and index 
creation system (one exists in the php- 
MyAdmin project), and make a fully 
fledged but simple clone of Microsoft Ac¬ 
cess— all web-based and built upon open 
and free tools. 


As more and more focus is placed on 
die web-based applicadon-service provider 
(ASP) model of application deployment, 
tools such as PHP and MySQL are going 
to become more popular. And since diey 
are open source, you can be assured of 
their longevity. Finally, they are perhaps 


the easiest serious web tools to learn and 
are a great way into the web-app devel¬ 
opment paradigm. 


DDJ 

(Listings begin on page 104.) 
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Listing One 

<html> 

<head> 

<title>My First PHP Script</title> 

</head> 

<body> 

<? echo "Hello World! (When you're on a good thing...)"; ?> 
</body> 

</html> 


Listing Two 

<?php 

# Include the class to handle database connections and queries (from PHPLIB) 
include("db.mysql.inc"): 

8 Extend the database class and overide the connection parameters 
class DB.Example extends DB.Sql ( 
var $Host = "localhost": 
var $Database = "test"; 
var $User = "webuser"; 
var $Password = "testing": 

) 

$db = new DB.Example: 

$db->query("SELECT * FROM address"); 
while ($db->next_record()) ( 

printf("%s %s<br>\n", $db->f("name"). $db->f("phone")): 

) 

?> 


Listing Three 


<7php 

require("oohforms.inc"): 

$f = new form: 

8 set up form elements 
$f->add_element(array("type"= 
"valid, 
"valid, 
"value' 

$f->add_element(array("type": 
if ($submitname) 

if ($err = $f->validate()) 
echo $err; 

$f->load_defaults(): 

) 

else ( 

printf("<b>%s</b><br>\n" 

) 

$f->start("example"): 

8 Show elements 
$f->show_element("foo"); 
$f->show_element("submitname* 
$f->finish(): 

?> <r 


# include the library 

# create a form object 

V'text", "name"=>"foo", 
regex"=>" /N [a-z]*$", 
e"=>"Letters only", "icase"=>l, 
=>"bar")): 

>"submit". "name"=>"submitname")); 

# Is there data to process? 

{ 8 Is the data valid? 

# No; Display error 

# Load form with submitted data 


$foo); # Data ok; Do something with it 

* Start displaying form 


"submit"); * Show elements 

# Finish form 


Listing Four 

<?php 

# Include the class to handle database connections and queries (from PHPLIB) 
include("db.mysql.inc"): 

# Include the DBF.FormEdit class 
include("dbf_form.inc"): 
include("dbf_form_edit.inc"); 

# Extend the database class and overide the connection parameters 
class DB.Example extends DB.Sql ( 

var $Host = "localhost": 
var SDatabase = "test": 
var $User = "webuser": 
var $Password = "testing": 

) 

8 Extend the DBF edit class and overide the database class 
class DBE.Example extends DBF.Edit { 
var $database_class = "DB.Example"; 

) 

8 Extend the DBF form edit class 
class DBF.Example extends DBF.FormEdit { 
var Sdbf.edit.class = "DBE.Example": ? Which dbf.edit class to use 

) 

8 Create an instance of the DBF edit class 
$dbf = new DBF.Example: 

$dbf->init(); # set up the DBF.FormEdit object 
8 Add table and the primary key 

$dbf->add_table(array("name"=>"address". "key"=>array("name"))): 

8 Add fields 

$dbf->add_field(array("type"=>"text"."name"=>"name")): 

$dbf->add_field(array("type"=>"text"."name"=>"address")): 
$dbf->add_field(array("type"=>"text"."name"=>"city")); 
$dbf->add_field(array("type"=>"text"."name"=>"state")): 

$dbf->add_field(array("type"=>"text"."name"=>"postcode")); 

$dbf->add_field(array("type"=>"text","name"=>"phone")): 

$dbf->add_field(array("type"=>"text","name"=>"email")): 

8 Add a form element 

$dbf->add_element(array("type"=>"submit"."name"=>"submit")): 
$dbf->add_element(array("type"=>"submit"."name"=>"delete")): 

print("<html>\n"): 
print(" <body>\n"); 

if ($submit) { # Check if there was a submission 
8 Save the form data to the database table 
$dbf->save(): 

) 


else if ($delete) ( 

* delete the record from the database 
$dbf->delete(): 

) 

else ( 

«» Load form data with data from the database table 

# Requires the primary key field(s) to have valid values 
« Calls DBF.Edit load.defaultsO 
$dbf->dbf_load_defaults(): 

) 

8 Calls form load.defaultsO, this will load defaults for all for elements. 
$dbf->load_defaults(); 

$dbf->start(): 

$dbf->dbf_show_elements(); 

$dbf->show_element("submit"."Save"): 

$dbf->show_element("delete","Delete"): 

$dbf->finish(): 
print(" </bodv>\n"); 
print("</html>\n"); 

?> 


Listing Five 

8 Extend the database class and overide the connection parameters 
class DB.Example extends DB.Sql ( 
var $Host = "localhost": 
var $Database = "test": 
var $User = "webuser"; 
var $Password = "testing": 


Listing Six 

8 Create an instance of the DBF edit class 
$dbf = new DBF.Example: 

$dbf->init(): i set up the DBF.FormEdit object 


Listing Seven 

8 Add table and the primary key 

$dbf->add_table(array("name"=>"address", "key"=>array("name"))): 

Listing Eight 

# Add fields 

$dbf->add_field(array("type"=>"text"."name"=>"name")); 
$dbf->add_field(array("type"=>"text"."name"=>"address")); 


Listing Nine 

if ($8ubmit) ( # Check if there was a submission 
it Save the form data to the database table 
$dbf->save(): 

) 

else if ($delete) { 

* delete the record from the database 
$dbf->delete(): 

) 

else ( 

ft Load form data with data from the database table 
» Requires the primary key field(s) to have valid values 

# Calls DBF.Edit load.defaultsO 
$dbf->dbf.load.defaultsO; 

DDJ 
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PROGRAMMER'S TOOLCHEST 



Examining the 
3D Game Studio Toolkit 

A powerful graphics tool that's easy to use 
Clayton E. Crooks II 


T he 3D Game Studio from Conitec 
(http://www.conitec.com/a4info.htm) 
is a Win32-based authoring system 
for creating interactive 3D applica¬ 
tions. The royalty-free package includes a 
3D engine, 2D engine, object-oriented 
scripting language, 3D map editor, actor 
modeler, game compiler, and run-time 
module. 3D Game Studio’s feature set is 
diverse enough to allow for the devel¬ 
opment of anything from third-person 
games to virtual tours of geographical 
locations. You can also use it for quick 
prototypes, nongame applications (such 
as virtual exhibits), or even 2D applica¬ 
tions. 3D Game Studio also includes two 
editors—the world editor (WED) and 
model editor (MED). The WED and MED 
combination make creating levels, plac¬ 
ing lighting effects, and modeling actors 
a straightforward process. In this article, 
I’ll provide an overview of the 3D Game 
Studio system, then build a typical three- 
room world and include actor move¬ 
ments. The scripts that implement this 
example are available electronically; see 
“Resource Center,” page 3. 

Building Environments and Models 

Defining a world with WED is intuitive. 
The editor resembles many popular 3D 
applications, with top, side, and back 
views, as well as a 3D preview of the lev¬ 
el. The package contains a library of over 


Clayton is a computer consultant in 
Knoxville , Tennessee. He can be contact¬ 
ed at crooks@planetc.com. 
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800 prefabricated textures, building parts, 
furniture, vehicles, weapons, and actors, 
which lets you create many types of vir¬ 
tual environments. Also, you can import 
file formats from computer games (like 
Quake), thousands of additional precon¬ 
structed levels (MAI 3 files), texture collec¬ 
tions (WAD files), and 3D models (MDL 
or 3DS files), most of which are available 
on the Internet. 

A 3D Game Studio level is an envi¬ 
ronment that’s as simple as a single land¬ 
scape or as complex as an entire city 
with stationery and moving parts. With¬ 
in this space, you can place static ob¬ 
jects such as light sources and sound 
sources that emit 3D background sounds. 
Three kinds of movable objects can also 
be placed within the level: models, cre¬ 
ated using MED and used for actors; 
sprites, in BMP or PCX format that can 
be designed with any Windows paint 
program; and map entities, which can 
be imported from different 3D file for¬ 
mats including 3D Studio. 

The WED uses blocks to build a level. 
This type of construction is known as 
“Constructive Solid Geometry” (CSG). 
Within the editor, you can design various 
sizes and shapes of blocks which can be 
added, subtracted, intersected, and meiged 
to create an almost endless supply of ge¬ 
ometry. 

MED is used to create the models for 
3D Game Studio. MED looks similar to 
the WED in that it shares the same ba¬ 
sic top, front, and back views, as well 
as a fourth view to visualize the model 
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in 3D. It has an easy-to-use interface for 
basic 3D model editing and animation. 
The interface also includes a skin editor 
and painter. The skin editor is used to 
import skins to display on a model, and 
lay out skin mapping coordinates that 
define what areas of the skin are mapped 
onto which areas of a model. The skin 
painter is a basic 3D painting utility for 
adding texture to models. While you 
could use an external paint program to 
create skins, the painter has all the ba¬ 
sic functions you need to quickly mod¬ 
ify the skins for models. 

In addition to the bundled tools, there 
are numerous third-party tools (World- 
Craft or Quake Model Editor, for in¬ 
stance) that can be used to fill voids you 
may find. 

Once the environment and models are 
completed, you set a “marker” for the de¬ 
fault start position of a level. The place¬ 
ment of additional map entities and sprites 
also take place at this stage. As soon as 
the levels are ready, it’s easy to generate 
file sets and executables for distribution 
via the Internet or CD-ROM. 

The 3D Engine 

At the heart of the development system 
is a 3D engine that runs the application, 
generates 3D effects, and controls the 
artificial intelligence of the actors and 
user interface. The general-purpose A4 
3D engine is both fast and flexible. It 
maps shadows, handles static and dy¬ 
namic worlds, and creates 2D or 3D ob¬ 
jects in real time. Due to a sophisticated 

http://www. ddj. com 
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SKILL VIDEO.MODE ( VAL 2; } // Set resolution to 320x240 

SKILL VIDEO_DEPTH { VAL 8; ) // Set to 8-bit color 


BMAP splashmap,<splash.pcx>; //Sets bitmap splashmap equal to 

splash.pcx 

PANEL splashscreen C BMAP splashmap; FLAGS REFRESH; } 

MAIN main; //Call the main Action 

ACTION main C 

SET splashscreen.VISIBLE,ON; // sets the bitmap on 

WAITT 16; //leaves it on for 1 second (16 ticks = 1 

sec.) 


SET splashscreen.VISIBLE,OFF; //turns the bitmap off 
LOAD_LEVEL <level1.wmb>; //now load our level 

CALL load status; // restore global skills 

) 
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Figure 1: Hollowing out a square to create an open room. 


Example 1: Sample splash screen. 


Figure 2: Approximate formation of rooms. 


(continued from page 106) 
three-fold culling algorithm, even huge 
worlds of 50,000 polygons are rendered 
without visible frame rate loss. Every¬ 
thing in the engine can be controlled 
with the World Definition Language 
(WDL) scripting language, allowing for 
the creation of artificial intelligence and 
behaviors for every object in the virtu¬ 
al world. 

According to Conitec literature, other 
engine features include: 

• Six degrees of freedom, true perspec¬ 
tive rendering. 

• Blazing fast, even without hardware ac¬ 
celeration. 

• Eight-, 16-, and 32-bit color, up to 
1600x1200 screen resolution. 

• Static light sources, 3D sound sources. 

• Shadow mapping, four-level mip map¬ 
ping. 

• Colored dynamic light sources, colored 
fog areas. 

• Real-time creation of polygon objects 
and entities. 

• Semi- and alphatransparency for sprite 
and flare effects. 

• Huge outside areas with animated sky 
and backdrop bitmap. 

• Multiple 3D views and customizable 
cameras for first- or third-person games, 
side scrollers, split screen, remote, or 
missile cameras. 

• Support for animated Model (MDL), 
Sprite (BMP, PCX), and MAP entities. 

• Smooth morphing for model frames. 

• Three-dimensional shape collision de¬ 
tection on fixed and moving world parts. 

• Realistic physics and quaternion-style 
multiaxis rotations. 

• Three-dimensional objects can be taken 
or manipulated by mouse in real time. 

• Bitmap particle generators for smoke trails, 
explosions, tornadoes, and the like. 

• CD audio, MID, and WAV support for 
music and 3D sounds. 

• Integrated 2D engine renders back¬ 
ground pictures, 2D sprites, panels, but¬ 
tons, sliders, overlays, 2D controls, text, 
and AVI movie scenes. 

• Multiplayer mode via split screen, mo¬ 
dem, network, or Internet. 

• Everything customizable by scripts— 
actors, weapons, physics, movement, 
game behavior, and user interface. 

• Unlimited level change. 

• Console mode for testing or script de¬ 
bugging. 

• Eight-bit mode for low hardware re¬ 
quirements. 

The World Definition Language 

With the WDL scripting language, you can 
give the UI and virtual world entities cus¬ 
tom behaviors. These custom lx?haviors are 
powerful enough to allow for development 
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of anything from an adventure game to a 
flight or vehicle simulator. 

WDL scripting allows control over ev¬ 
erything in a 3D Game Studio world— 
actors, weapons, vehicles, platforms, ef¬ 
fects, traps, puzzles, buttons, menus, and 
even external I/O devices such as track¬ 
ers or light shows. Scripts can be attached 
to every entity, and can be triggered by 
certain events of the virtual world, like be¬ 
ing clicked on, coming within a certain 
distance to another entity, spotting a play¬ 
er, or whatever you imagine. All language 
actions and properties follow simple nam¬ 
ing conventions, with a syntax similar to 
C or JavaScript. It’s not difficult to pick up 
the language, and the package includes a 
large collection of WDL scripts so that you 
can develop programs using predefined 
scripts or modifying them as necessary. 

Sounds and Multimedia 

Because some basic sound and video 
functionality has been omitted, the mul¬ 
timedia capabilities (or rather, lack there¬ 
of) are the main complaint I have with 
3D Game Studio. The toolkit automati¬ 
cally handles all detection and configu¬ 
ration of a variety of sound cards with¬ 
out any interaction from you or end 
users. It also passes joystick, mouse, and 
keyboard inputs without the need for 
even a single line of code. In games, 
sound effects use distance-dependent 
volume controls. This lets a distant ob¬ 
ject sound far away, and get louder as 
you approach it. 

In addition to the ability to play spot 
effects, the toolkit supports MIDI files for 
background music, and supports the .IBK 
format for FM-synthesized instruments 
and drums. Although the toolkit does not 
support MP3 (depending upon the ver¬ 
sion you purchase), CD audio music is 
available. 

3D Game Studio currently supports only 
AVI for video playback. Adding support 
for MP3 or other compressed audio for¬ 
mats along with options for additional 
video playback is a must for future de¬ 
velopments. 

Putting the Engine to Work 

To illustrate how you use 3D Game Stu¬ 
dio, I’ll quickly build a three-room world 
in the WED, then add an actor that has 
movement actions. 

After opening WED, select New from 
die File menu, and you are presented four 
blank window views: Top, Back, Side, 
and 3D. (It’s easier to see what the final 
output is going to be if you turn the 3D 
View window to Render with textures.) 
Next, you add a large cube to Level by 
selecting it from the Object menu. You 
then hollow out the square to create an 
open room. This is done using the built- 


(a) 

// some string definitions 
STRING info "We are learning WDL"; 

(b) 

ACTION info 
( 

SET msg.VISIBLE.ON //Sets message on 

SET msg.STRING,info; //Sets message to "We are learning WDL” 
0N_P show.info; 


Example 2: (a) WDL example that creates a string; (b) using the Action 
command. 
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Figure 3: Nearly completed level. 


in Hollow Block command in the Edit 
menu; see Figure 1. 

You copy and paste the square four 
times, placing it in some form of inter¬ 
secting room pattern. Figure 2 is the ap¬ 
proximate formation of rooms. To create 
an opening between the rooms, place an¬ 
other cube in the level and locate it where 
there is a need for an opening. 

Once in place, it’s easy to remove ar¬ 
eas that are intersecting with the newly 
placed cube. Using another WED built- 
in command (CSG Subtract) cuts away 
areas the cube is touching. Repeat this 
as necessary to create doorways to all 
the rooms. Next, you place light sources 
throughout the level, which is done ba¬ 
sically the same way as placing the 
cubes. 


After placing three or four light sources, 
you’re ready to preview the Level. Press 
the Build button from within WED. If 
you’ve done everything okay, you’ll see 
a level like Figure 3. 

WDL Programming 

Once a map has been developed, it’s 
time to delve into WDL. (Note the unique 
naming conventions used in 3D Game 
Studio. For instance, instead of calling a 
“variable” a variable, it’s called a “skill.”) 
In the examples presented here, I’ve 
placed comments before and after sev¬ 
eral lines of code. For comments in A4, 
just use “//” at the beginning of a line 
or for several lines you can use a “/*” 
combination to begin and a “*/” to end 
the comment. 


//this is a comment 
/* this is a multi 
line 

comment */ 

At the beginning of a WDL file, a di¬ 
rectory path should be given, and addi¬ 
tional WDL files can be included. If you 
include them, you'll have access to all of 
their functions from within your level’s 
main WDL file. Each WDL statement or 
instruction must end with a semicolon. If 
you forget, you get numerous errors from 
the engine. 

To run a script, place the WDL file into 
your map using the File/Map Proper¬ 
ties/Scripts options from within WED. To 
create a new script, select New and a de¬ 
fault name will appear, such as the name 
of your level followed by the WDL exten¬ 
sion. This is the text file I’ll be entering all 
of the scripts into. It will already have in¬ 
formation regarding the basic setups for 
the level, including built-in \\T)L templates 
(to access them, they should be copied to 
your working directory), supported video 
displays, and main action. You can use a 
text editor to view and edit this file. 

To display an opening credit splash 
screen at application start, define that splash 
screen as a PANEL in the WDL script; see 
Example 1. The two SKILL definitions state 
the initial screen resolution of 320x40, 
and 8-bit color mode. The first three lines 
of the main action, which is executed at 
game start, display the splash screen for 
16 ticks (approximately 1 second) before 
loading the virtual world. To run the sam¬ 
ple, you must design the splash screen. 
With a graphics editor, create a file called 
SPLASH.PCX, scale it to the appropriate 
resolution, and reduce it to 256 colors. 

Again, strings can save text information. 
Example 2(a) is an example of WDL that 
creates a string. Example 2(b) displays the 
string using the Action command. After plac¬ 
ing this code into our WDL file, run the 
WED level by clicking the Build button. 
Tills will place you inside your virtual world. 

Our next step is to place an actor onto 
the screen for us to move. Copy the 
Guard.null file (included in the installa¬ 
tion of 3D Game Studio) into your work 
directory. (In fact, it would be a good time 
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to copy the entire prefab WDL files into 
your work directory if you haven’t yet 
done so.) Place the model somewhere in 
the level using the WED Load Entity com¬ 
mand and right-click on it. Select Proper¬ 
ties from the pop-up menu and choose 
the player_walk action. Figure 4 shows 
that the move is already available because 
I placed the prefab WDL files within my 
directory and used die INCLUDE function 
to add them to the available actions (ac¬ 
tually, by allowing WED to design the ba¬ 
sics of my level WDL file, it included this 
information automatically). 

With only a few lines of WDL code, 
you have a virtual environment complete 
with a movable guard and a light source. 
This is just a simple overview of die pow¬ 
er behind the A4 engine and WDL script¬ 
ing language. 

Conclusion 

3D Game Studio is a powerful piece of 
software for anyone who wants to write 
3D applications. The toolkit provides a 
complete environment for 3D authoring 
with only a few minor omissions for au¬ 
dio and video playback options. Another 
area that should be developed is an open 
architecture that would allow for plug-ins 
or some odier fonn of user-developed cre¬ 
ation of add-ins. 


Figure 4: A move is already available. 

Aldiough the tools are easy to use, I still 
wouldn’t recommend the kit for novices, 
since the toolkit does require some pro¬ 
gramming skills and concepts. Experience 
in some sort of structured programming 
language would be advantageous. Still, if 


you’re looking for an excellent toolkit to 
quickly prototype and develop 3D graph¬ 
ics application, you will definitely want to 
check out Conitec’s 3D Game Studio. 
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PROGRAMMING PARADIGMS 

Declarative 

Programming Revisited 


Michael Swaine 


A little book that recently came across 
the transom got me to thinking 
about some issues that I hadn’t ex¬ 
plored in such depth in a long time. 
I found myself reexamining logic pro¬ 
gramming, the declarative paradigm, and 
the value of studying obscure, old pro¬ 
gramming languages. Like Prolog. To the 
five readers who took offense at that, yes 
I realize that Prolog isn’t obsolete. It only 
became an ISO Standard in 1995, and it 
is in wide use throughout the world in a 
wide variety of applications and on a 
wide variety of platforms. The word “va¬ 
riety” is apt here; I’ve been playing 
around with a BeOS implementation of 
Prolog that began its life as a Newton 
program. But that’s not why I called Pro¬ 
log obscure; it’s because I’m betting that 
a majority of Dr. Dobb’s readers have nei¬ 
ther written a Prolog program nor expect 
ever to write one. 

The book is available, accessible, and 
by a well-known author. It’s What Not 
How: The Business Rules Approach to 
Application Development , by C.J. Date 
(Addison-Wesley, 2000; ISBN 0-201-70850- 
7). This book is probably not one we’d 
put high on the list of book-review can¬ 
didates here at Dr Dobb’s (and this col¬ 
umn will not be a review of it). The first 
half of the book is a manager’s guide, 
aimed at people with little or no pro¬ 
gramming experience, and the second half 


Michael is editor- at-large for DDJ. He can 
be contacted at mswaine@swaine.com. 

http://www.ddj.com 


mostly reviews material that anyone who 
has done database programming already 
knows, although it covers this material 
from a particular perspective to make a 
particular, not uninteresting, point. 

Also not in the book’s favor, from the 
Dobbsian perspective: It’s only 130 pages 
long, is written in a chatty style because 
it apparently began its life as a script for 
a live presentation, and it was commis¬ 
sioned by a company that has an inter¬ 
est in promoting business rules—some¬ 
thing that Date does enthusiastically in 
the book. Also, despite the subtitle, it’s 
not even really about application devel¬ 
opment. 

Nevertheless, I got a lot out of reading 
the book. Date’s credentials in database 
programming are solid. His An Intro¬ 
duction to Database Systems is a standard 
text in the field and has sold over half a 
million copies. He was involved in tech¬ 
nical planning for IBM’s SQL and DB2 
products and has been one of the chief 
promoters and clarifiers of the relational 
model for database programming. He is 
also passionate about the subject of busi¬ 
ness Riles, and the fact that he wrote the 
book under contract to a business rules 
company is probably not important, since 
he doesn’t promote its—or anyone’s— 
products in the book and would doubt¬ 
less be promoting the use of business 
Riles regardless. As I followed the threads 
of Date’s What Not How theme out of 
his book and onto the classic languages 
shelf here at Stately Swaine Manor, and 
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finally back to the book with some fresh 
perspective on the issues discussed, I 
found myself rethinking an old affection 
for paradigmatic purity. 

Business Rules 

Business Riles make up the recalcitrant 
“third component” of business software. 
The other two are the presentation and 
database components, for which there are 
many tools in existence to automate var¬ 
ious aspects of the development job. The 
third component, business Riles, encom¬ 
passes the knowledge specific to the par¬ 
ticular business, and has traditionally not 
had many tools dedicated to automating 
its tasks. Some business Riles might be: 

pay = salary + commission + bonus 
commission + bonus < $5000 
total_owed <= creditjimit 
if quantity_on_hand - quantity_ordered < 
reorderjevel then reorder 
customers whose accounts are overdue 
must be displayed in red 
an employee has one manager 
never_married -> widowed is not a valid 
transition 

legal supplier numbers are of the form 
Snnnn 

if the portfolio_value of Account > 25000 
or at least 50 Trades of 
Account satisfy Commission > 29.95 then 
the enterprise_value of Customer 
is “GOLD” 

the items covered by a lease can change 
during the term of the lease so 
long as the monthly lease payment does 
not decrease 
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This is a very mixed bag. Some of these 
rules indicate an action to be taken (re¬ 
order), while others express constraints 
or look like instructions to programmers 
or database designers. The question mo¬ 
tivating Date’s book is this: “How do we 
automate the processing of such a messy 
collection of admonitions?” 

Having characterized the content of 
this component in the way that he has, 
Date has pretty much answered his own 
question. If business rules are expert 
knowledge, the natural conclusion is that 
we need some sort of expert system to 
embody and process that knowledge, 
along the lines of expert systems in med¬ 
ical diagnosis and other fields. That 
means declarative programming, which 
differs from procedural programming pre¬ 
cisely in its emphasis on specifying what 
to do rather than how to do it, hence the 
book’s title. 

Executable Specs 

One phrase that nicely communicates the 
promise of the declarative paradigm is 
“executable specs.” It has a nice ring to 
it, doesn’t it? The task of developing soft¬ 
ware would become a whole lot easier 
if you were finished when you had writ¬ 
ten the specs. 

Business rules are specs. And business 
Riles are declarative—mostly. A few busi¬ 
ness Riles are phrased procedurally: 

if quantity_on_hand - quantity_ordered < 
reorderjevel then reorder 

but most impose some constraint: 

total_owed <= credit Jimit 
or define something: 

pay = salary + commission + bonus 
or assert something: 

legal supplier numbers are of the form 
Snnnn 

all of which are declarative acts (even if 
one of them looks like an assignment 
statement). 

Date’s book is about making this par¬ 
ticular kind of spec executable. To make 
business rules executable, you need an 
appropriate language for interpreting and 
executing these rules, and Date sum¬ 
marily dismisses Java, C++, and other ob¬ 
ject-oriented languages for this purpose, 
although there are certainly Java- or C++- 
friendly bizrule tools available. More than 
just a language, you need an engine to 
interpret these constraints and apply 
them where relevant. An expert system, 
in effect. Add that it needs to be effi¬ 
cient, with compiled rather than inter¬ 
preted rules, and sophisticated opti¬ 
mization. 
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Although I do database development 
for my partner’s business (an organic 
farm and restaurant), I hadn’t thought 
about business rules as anything but part 
of the documentation on how the 
database files are constructed and used. 
Unsophisticated, I know. 

When Date got me thinking about the 
idea of automating these rules, I immedi¬ 
ately flashed back to my study of Prolog. 

The Past is Prolog 

Reading Date sent me back to the dusti¬ 
er shelves and to books I hadn’t read in 
years. Is there value in studying old pro¬ 
gramming languages? I’ve always thought 
so, or rather, I’ve thought that the value 
in studying old languages was directly re¬ 
lated to the purity of the conceptual un¬ 
derpinnings of the language. 

I went to college in an era when histo¬ 
ry was being denigrated. “What’s the rel¬ 
evance?” The answer was usually, none. 

The world seemed to be changing 
rapidly then, and it seemed appropriate 
to ask what relevance the past had for our 
present and future. In retrospect, it seems 
sad that we of that generation failed to 
see die value in studying the past. Not just 
my generation, of course. The sense that 
the world is changing rapidly hasn’t abat¬ 
ed, and I don’t see any renaissance of in¬ 
terest in history. 

So in pitching the importance of study¬ 
ing old programming languages, I come 
from a historically challenged perspec¬ 
tive and I suspect I speak to a histori¬ 
cally challenged audience. But pro¬ 
gramming is about process, not content, 
and past languages can be mined for 
good techniques, practices, and insights. 
The clearer those insights are, the less 
they are embedded in irrelevant imple¬ 
mentation details, the more likely they 
are to reward study. 

If you buy that, you’ll agree that study¬ 
ing McCarthy’s original Lisp is an ap¬ 
propriate way to get back to basics and 
clear your mind of irrelevant details in 
thinking about functional programming. 
Another mental cleansing agent might be 
Chuck Moore’s original Forth. If you 
don’t buy that argument, you’ll probably 
point out that some ideas that once de¬ 
fined whole languages or schools of 
thought in programming or paradigms 
have now become mere tools in the pro¬ 
grammer’s bag of intellectual tricks. 
Snobol, historically, seemed to offer a 
different paradigm of programming. But 
standards of originality evolve, and to¬ 
day I suspect we would see the histori¬ 
cal Snobol as a one-trick pony, doing lit¬ 
tle more than string processing via a 
syntactic minimalism that reduces ev¬ 
erything to one or another variant of a 
single test/branch/replace statement. The 


kind of thing that computer science stu¬ 
dents invent when they create their own 
UNIX batch programs. I guess my re¬ 
sponse would be that not all paradigms 
are equal, and that some are so rich and 
powerful that they are worthy of being 
examined in the purity of their original 
implementations. If so, the declarative 
programming paradigm as implemented 
in Prolog has to be one of these. 

Declarative Programming 

Although some of my Prolog books are a 
little dusty, Prolog is still alive and vital. 

Prolog was invented at the University 
of Marseilles by Alain Colmerauer in the 
early 1970s. It got a big lx>ost in 1981 with 
the publication of Programming in Pro¬ 
log by W.F. Clocksin and C.S. Mellish (orig¬ 
inal edition Springer-Verlag, 1981). Other 
inflection points in the curve of its adop¬ 
tion occurred when the Japanese adopt¬ 
ed it for their massive Fifth Generation AI 
project in 1982, and in 1984 when Bor¬ 
land came out with its low-cost, efficient 
Turbo Prolog for PCs. Prolog became the 
official language for much work in artifi¬ 
cial intelligence during this time. It took 
another decade before Prolog became an 
ISO Standard, but that finally happened, 
too, in 1995. 

While artificial intelligence was earning 
a reputation for not delivering on the 
hype, one branch of AI—expert sys¬ 
tems—was quietly turning out useful 
products. Expert systems, generally writ¬ 
ten in Prolog, were of actual value in many 
fields, and led directly to systems for pro¬ 
cessing business rules. Last year, IBM 
showed off a prototype of CommonRules, 
a Java library for declarative logic pro¬ 
grams for processing rules. CommonRules 
also embraces an XML interlingua called 
“Business Rules Markup Language” 
(BRML). (CommonRules grew out of an 
earlier project whose buzz phrase was “in¬ 
telligent agents” and whose implementa¬ 
tion language was C++; now it’s “business 
rules” and Java plus XML. Who says IBM 
is stodgy and uncool?) 

Every Prolog system (program? database?) 
is, basically, a resolution theorem prover 
for Horn clauses. There are two terms in 
that sentence that require definition. 

“Resolution” is a rule of inference dis¬ 
covered byj. Allen Robinson in the 1960s 
that can be used to automate deductive 
reasoning. Resolution operates on claus¬ 
es, which are a calculationally conve¬ 
nient way of representing propositions 
in the predicate calculus. Given two 
clauses related appropriately to one an¬ 
other, resolution will automatically gen¬ 
erate a third clause that is the logical con¬ 
sequence of the first two. A Horn clause 
is just a clause with at most one un¬ 
negated literal, such as: 
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person(adam) 

person(eve) 

person(X) OR NOT motherCX , Y) OR NOT 
person(X) 

(Each of these has exactly one unnegat¬ 
ed literal.) If you use the Prolog notation 
of for “is implied by,” and the Prolog 
convention of ending each clause with a 
period (.), you can rewrite these as: 

person(adam) . 
person(eve). 

person(X)motherCX , Y), person(Y) . 

The first two are facts, the third is a rule. 
Resolution is both correct and refuta¬ 
tion complete. This means that a system 
built on the resolution principle, when 
repeatedly applied to a set of mutually 
inconsistent clauses, will derive the emp¬ 
ty clause and only the empty clause. The 
empty clause represents falsity in such 
systems. This in turn means you can use 
resolution to prove any clause that it is 
possible to derive from a given set of 
clauses. You do this simply by showing 
the inconsistency of that set of clauses 
with the negation of the target clause. 
For example, given the aforementioned 
set of clauses and the goal clause per- 
son(adam), you would negate it and re¬ 
solve the negation against the set of 


clauses. Since this negated clause directly 
contradicts one of the clauses in the set, 
the (unnegated) goal clause is proved. 

It turns out that Horn clauses are all 
you need to express the knowledge you’d 
like to put into a theorem prover, which 
is convenient. It’s also convenient that if 


Business rules make 
up the recalcitrant 
“third component ” 
of business software 


you restrict yourself to Horn clauses—in 
particular to one clause with no unnegat¬ 
ed literal and the rest with exactly one un¬ 
negated literal—you can solve any solv¬ 
able theorem-proving problem defined 


on that knowledge base, and can do so 
relatively efficiently. 

A Prolog system works like this: You 
provide it with a set of Horn clauses, ex¬ 
actly one of which has no unnegated lit¬ 
erals. This particular clause is referred to 
as the goal and the others are called “hy¬ 
potheses.” The system first resolves the 
goal with one of the hypotheses to pro¬ 
duce a new clause. It then resolves this 
new clause with another hypothesis to 
arrive at a new clause, repeating the pro¬ 
cess until the empty clause is derived. 
How do you get from theorem proving 
to enforcing constraints in a set of busi¬ 
ness rules? Well, it turns out that exact¬ 
ly the same declarative syntax can serve 
both purposes. The goal member(2, [1, 
2,3,4}). asks Prolog whether 2 is a 
member of the list, but the goal mem- 
ber(X , (1 ,2,3,41). asks Prolog to find 
all members of the list. To do some 
things (consider the reorder business rule 
previously mentioned) Prolog, or any 
business rule processing system, will oc¬ 
casionally slip out of paradigm and do 
something through a side effect. 

The Relational Model 

Back to Mr. Date and his business rules. 
In section 2 of the book, Date argues 
that the processing of business rules is 
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an essential part of a different paradigm, 
one noted for the mathematical purity 
of its original definition—the relational 
database model. An integrity constraint 
(which is really a business rule) is a con¬ 
ditional expression that must evaluate to 
true, such as total_owed <= credit Jimit. 
Such constraints, Date argues, are crucial 
to controlling the correctness of the data. 

He then goes on to give an interpreta¬ 
tion of the relational model of databases 
that he never got from the model’s cre¬ 
ator, E.F. Codd. Date claims, though, that 
this is what Codd really meant. 

A database, Date argues, is best per¬ 
ceived not as a collection of data but as a 
collection of true propositions. The entire 
database, in fact, represents a single propo¬ 
sition: the AND of all the propositions in 
(and applicable to) the database. And the 
rows of a relational table—the rows of the 
relation— are true assertions about tilings 
in the domain of the relation. 

Business rules are crucial to the relational 
model and should lie built into the DBMS, 
Date says, because they are part of what 
the system understands to lie the meaning 
of the tilings it deals with. So the system— 
the DBMS—can’t do updates to these 
things properly without knowing and en¬ 
forcing those constraints. Date quotes Gary 
Morgentlialer, former Ingres CEO: 


Rules...might be seen as finally delivering 
on a long-unfulfilled promise of the [rela¬ 
tional DBMS] revolution — the ability to 
move data integrity enforcement.. .into a lo¬ 
cation where it can be [applied! across all 
applications consistently. 


Every Prolog system 
is, basically, a 
resolution 
theorem prover 


In other words, Date concludes, the rule 
engine ought to be part of the DBMS, 
specifically the top level of the DBMS, ca¬ 
pable of using DB2, Oracle, or whatever 
back-end database system is desired. 


Date thinks that this was more or less 
the idea all along, that business rule pro¬ 
cessing is an inherent part of the relational 
model and of any proper DBMS system, 
and that DBMS makers got distracted and 
left out the best part. He’d like to see that 
oversight rectified. 

Me, I’m bemused. I started out follow¬ 
ing the thread of the conceptual purity of 
one paradigm—declarative program¬ 
ming— and I ended up inside a call to 
purify a completely different paradigm— 
the relational database model—and re¬ 
store it to its original intent. And between 
the one pure vision and the other is the 
fuzzy realization that the two paradigms 
aren’t as different from one another as 
they seem. Curious. 


DDJ 
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C PROGRAMMING 

Twelve Years and 
Still Complaining 



Al Stevens 


T his month is my 12-year anniversary 
writing this column, and I guess 
there’s not going to be a surprise par¬ 
ty. After 10 years, they at least gave 
Jon Erickson a lifetime supply of free cof¬ 
fee at a local espresso den a short walk 
from his office. That’s all Jon needed— 
more caffeine. Each morning, he takes a 
leisurely stroll to the coffee shop and 
sprints back to work in leaps and bounds, 
pirouetting along the way. Anyway, hav¬ 
ing lasted a dozen years, and with no free 
corporate cappuccino to jolt me into do¬ 
ing some real work, I get to lay back and 
cogitate a bit on what bugs me. 

Loving Bugs 

What bugs me this month are love bugs. 
Every now and then, a computer virus 
takes the world by storm and by surprise. 
The so-called “Love Bug’’ virus is now set¬ 
tling down, and we programmers are 
amazed once again by the simplicity with 
which a mischievous programmer can fool 
people. The Love Bug virus depends on 
the trustful nature of people and their rel¬ 
ative technical naivete. The virus is an at¬ 
tachment to an e-mail message in the form 
of a Visual Basic script. The e-mail mes¬ 
sage, which has the subject ILOVEYOU, 
promises an affectionate message in the 
attachment for the recipient. When you 
double-click the attachment’s icon to run 
the script, the script does malevolent things 
to your files and then sends itself to ev¬ 
eryone in your address book, assuming 
you use Microsoft Outlook for e-mail, 
which virtually everyone does. All your 
correspondents receive what looks like an 
affectionate message from someone they 
trust—you. 


Alisa DDJ contributing editor. He can be 
contacted at astevens@ddj.com. 
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The virus works because most people 
do not know the meaning of the VBScript 
icon and file extension, and they do not 
know not to double-click something they 
do not know anything about. The virus’s 
effect is a two-edged sword. Not only 
does it maliciously damage the files of 
anyone who runs the script, it also clogs 
your inbox with numerous copies of itself 
from everyone who knows you and is sim¬ 
ilarly infected. And it also overloads the 
e-mail transport system worldwide. Me¬ 
dia experts, whoever they are, estimate 
$10 billion in lost employee time. I won¬ 
der where they got that number. When 
employees read personal e-mail on the 
clock, it’s difficult to measure the cost of 
time used, much less lost. How about the 
cost of time lost reading personal e-mail? 

From my limited perspective, the real 
log jam came not from the virus itself, 
but from the well-intentioned messages 
warning me about it. I did not receive a 
single copy of the Love Bug virus. In 
fact, I’ve never received any virus of any 
kind. But I did, and always do, receive 
countless warnings. Where are the ex¬ 
perts to measure the loss of employee 
time spent sending and receiving virus 
warning messages? 

Microsoft posted a patch to Outlook 
that disables its ability to run executable 
attachments and warns you if any program 
tries to send e-mail to the folks in your 
address book. Where are the experts to 
measure the loss of employee time getting 
around the patch when legitimate exe¬ 
cutable attachments need to be run? What 
do we pay for the compromised func¬ 
tionality of mail-enabled applications that 
can no longer use the address book with¬ 
out user intervention? 

The real irony would be if Bill Gates 
sent “I love you” to Janet Reno several 
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hundred times a day. That would some¬ 
how make it all seem worthwhile. 

The Blocking Bug 

The Love Bug virus is not the love bug 
that bugs me today. I spend a lot of my 
time on the road in search of new stories 
to write, traveling in the RV, which was 
once christened the “Titanic,” and is now 
rechristened the “DobbsMobile” (the pic¬ 
ture at the bottom of page 120 shows 
why). Much of that travel is through the 
southeastern states. Those who visit Flori¬ 
da and south Georgia in the spring and 
fall know well the original love bug. Those 
kids in Manila think they made things un¬ 
comfortable with their Love Bug virus. 
They should try driving through swarm 
after swarm of Florida love bugs. 

The Florida love bug is an insect in¬ 
digenous to the southeast whose pecu¬ 
liar mating ritual gave the bug its name. 
They do it in flight. In fact, that’s all they 
do. Or, at least, that’s all anyone has ever 
seen them do. Occasionally, you’ll find 
a love bug staggering around on the 
ground by itself, basking in the afterglow 
and smoking a cigarette, but mostly they 
fly—I suppose love bug foreplay is taxi¬ 
ing— and you run into them in pairs in 
the air. Literally. During their airborne 
trysts, each couple maintains an altitude 
ranging from the top of a vehicle’s wind¬ 
shield to the bottom of its grill. That’s 
their strike zone. Being gregarious crea¬ 
tures with no concept of propriety or 
privacy, they do it in orgies, er, swarms 
at those altitudes. Several thousand cou¬ 
ples happily inducting one another into 
the meter-high club, almost always di¬ 
rectly over well-traveled pavement. 
You’re tooling down Florida’s scenic 
route A1A just fresh from the carwash 
and listening to Jimmy Buffet when, 
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“Splat!” Reproductus interruptus several 
thousand times over. 

The consequence of all this lover’s sui¬ 
cide is a mess of coupled bug corpses all 
over the front of your vehicle. To combat 
the invasion, accessory manufacturers in¬ 
vented the vehicle “brassiere,” a titillating 
but descriptive name for a vinyl cover that 
protects the front finish and radiator from 
a massive smear that would spoil paint 
and block airflow. As we speak, the 
DobbsMobile’s brassiere, shown in the 
picture sporting its new Dobb’s logo and 
without any buggy blemish, is a mass in¬ 
sect grave that I have to clean up. 

I wish those pesky love bugs would 
just go take a flying...er, I wish they’d 
just go away. 

Mixed, Muddled Metaphors 

We programmers can’t get our metaphors 
straight. Our thinking is all mixed up. Look 
at the things we design. We love metaphors 
but don’t understand how to use them 
properly. Consider Windows, created by 
programmers, and used by so many peo¬ 
ple that it violates antitrust laws, or so they 
said. The ubiquitous Windows user inter¬ 
face is a morass of mixed metaphors that 
just don’t fit. Some were pilfered, er, in¬ 
herited from earlier operating environ¬ 
ments, and others were contrived by pro¬ 
grammers who built Windows. Let’s 
consider some real things that Windows 
uses to represent GUI components. 

Let’s start with the desktop. I’m looking 
at my desktop, what I can see of it. My 
real desktop. The top of my desk. First off, 
it’s horizontal not vertical. Otherwise ev¬ 
erything would slide off. Duh. My desk¬ 
top contains my computer, telephone, 
books, a coffee cup, some CD-ROM cas¬ 


es with and without CD-ROMs (which may 
or may not match the labels on the cas¬ 
es), random notes and papers, diskettes, 
car keys, an uneaten wedge of pizza from 
sometime last month, five empty soda cans, 
several pencils that need sharpening, an 
electric pencil sharpener that quit work¬ 
ing last year, back issues of newspapers 
and magazines, and clutter. There’s not a 
folder, window, or shortcut anywhere on 
this desktop. Okay, there could be a fold¬ 
er or two, but I’m not that well organized, 
and folders not in use ought to be in file 
cabinets, not on desktops. 

Folders? If I had a folder on my desk¬ 
top I could open it and look inside, where¬ 
upon it would certainly not transform it¬ 
self into a window, that’s for sure. That 
would be scary. Hey, what happened to 
my folder? It’s a window now, not a fold¬ 
er. Huh? 

What’s a window? I’m looking out my 
office window now. I can see through it 
to my yard, which needs mowing. The of¬ 
fice window is transparent like a window 
ought to be. I can see what’s beyond it, 
not what’s in it. It’s closed, too, to keep 
the flies out. When I open the window, I 
see the same things that I see when it’s 
closed except that I see them better, with¬ 
out the dirt and spiderwebs. When I close 
the window, guess what? It doesn’t dis¬ 
appear! I wish it would so I wouldn’t be 
reminded that my window needs wash¬ 
ing and my lawn needs mowing. 

Can’t find any shortcuts on this old desk¬ 
top, either. I took a shortcut yesterday into 
the woods behind the house so Judy 
couldn’t find me. She wanted me to take 
her to Wal-Mart. We had a dialogue about 
that later. (Notice I used the preferred 
spelling.) 


What’s a dialogue, er, dialog box? Wait 
a minute. A box? Not a window? Certain¬ 
ly not a window box. No, it’s a box and 
it’s also a dialog. Huh? I know what a box 

is. It’s a three-dimensional rectangular con¬ 
tainer into which I throw stuff. I use a lx>x 
for a trash can whenever I clear my desk¬ 
top. I don’t drag the stuff to the trash can, 
though. Some of it, like that old pizza, 
would leave a smear. Can’t be dragging 
stuff around here. I pick it up and throw 

it. Unless I eat it. 

A dialogue, on the other hand, is a con¬ 
versation between two people. Unless one 
of them is your wife. Then it’s a mono¬ 
logue. Output only. Shut up and listen. 
How come Windows has “dialog boxes” 
that only tell us something? Why aren’t 
they called “monologue boxes?” The OK 
button by itself doesn’t constitute two-way 
communication. Judy’s monologues have 
an OK button. I press it by saying, “Yes, 
Dear.” I have to use it, but it doesn’t add 
any information. I am not permitted to 
press her Cancel button; it is disabled. Her 
Help button always delivers the same di¬ 
alogue, er, monologue, which says, “You 
know perfectly well what I mean.” “Yes, 
Dear.” 

Recycle bin? Give me a break. I have a 
real recycle bin in the garage. Someday 
I’ll get around to putting those empty soda 
cans and newspapers in it, and the coun¬ 
ty will come get the stuff and process it 
for reuse. (Hmm, maybe they can make 
penicillin out of the pizza.) How, pray tell, 
does my real recycle bin relate to the Win¬ 
dows recycle bin? Well, Microsoft had to 
come up with a name other than “trash 
can” because Jobs already used that one 
and he and Gates weren’t exactly chum¬ 
my when Windows was ripping off, er, 
being influenced by the Mac’s metaphors. 
“Shredder” might have worked except for 
the sinister connotation associated with 
people shredding evidence. There are bet¬ 
ter metaphors for deep-sixing stuff than 
a recycle bin. Maybe an icon with a flush 
handle? 

“Icon” used to mean a sacred religious 
image of a saint. I don’t keep any pictures 
of saints on my real desktop. No analogy 
to that anywhere on my Windows desk¬ 
top, either, for that matter. 

Go to your desktop—the virtual one— 
and open My Computer. (Actually, open 
yours.) See those little drive letters. We 
hairy-chested he-man command-line users 
understand one letter and a colon. That’s 
sometliing a guy can get his hands around. 
Those sissy GUI dependency geeks need 
icons, or so say the designers of Windows. 
Now, select a drive icon that represents a 
hard drive. Windows calls it a “Local Disk.” 
Select a CD-ROM drive. Windows calls it a 
“CD-ROM Disc.” What is the difference be- 
tween a disk and a disc? Windows calls the 
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diskette drive a “3 1/2 Inch Floppy Disk.” 
Hey guys, catch up to the 21st century. 
They’re encased in hard plastic. They don’t 
flop anymore. 

And Finally, how about menus? Who de¬ 
cided to call them that? Real menus don’t 
have commands, they have food—lists of 
items from which you may choose some¬ 
thing to eat. Imagine a menu command¬ 
ing you, “You will have the catch of the 
day!” And by the way, where’s my senior 
citizen discount? 

Breaking Up Is Hard to Do 
(continued from last month) 

Several weeks ago, the Justice Department 
forwarded its recommendations to the 
judge who found Microsoft guilty of ne¬ 
farious business practices. By now, ev¬ 
eryone knows the recommendation—that 
Microsoft follow in the footsteps of Stan¬ 
dard Oil, American Tobacco, and AT&T 
and be broken up, in this case into two 
companies— one to do Windows and one 
to do applications software and Internet 
stuff. Justice didn’t say who gets the de¬ 
veloper stuff, at least not in the media cov¬ 
erage of the recommendation. I wonder 
which company gets Bob. Who? Oh, 
you’ve already forgotten. 

The Justice Department postponed its 
announcement until just after the stock 


market closed on Friday hoping investors 
would forget about it over the weekend 
and the decision would not cause any 
panic selloffs and cut into the billions of 
Gates and Ballmer. Nice of them to do it 
that way. Microsoft stock went up three 
bucks on Monday, down three bucks on 
Tuesday, and almost nowhere the rest of 
the week. Business as usual. Nothing at 
all like the drop following the guilty ver¬ 
dict a month before. I guess it’s more 
shameful to be guilty than it is to be cut 
down the middle. Do you suppose some¬ 
one read the parable of King Solomon and 
the baby and missed the point? 

None of the media caught the irony in 
the government’s use of Gates’ e-mail as 
evidence. Doesn’t anyone ever learn? Isn’t 
that how they nailed Ollie North? You’d 
expect it from an officer, but hey, Bill! 
Hey, techiest of the new age technocrats! 
Hey, world’s smartest, richest nerd! EN¬ 
CRYPTION! 

Under the Justice recommendation, the 
operating-system company is allowed to 
license Internet Explorer from the appli¬ 
cation company until the operating-system 
company develops its own browser. Huh? 
I thought the idea was to separate the op¬ 
erating-system guys from the browser guys 
to eliminate unfair competition with oth¬ 
er browser developers. Furthermore, the 


application company is free to continue 
supporting its applications on Windows 
but is equally free to develop its own op¬ 
erating system. Huh? Oh, I already said 
that. The applications guys are permitted 
to port all their heavy-duty applications to 
other operating systems, such as GO, the 
Mac, and Linux. Yeah, right, just like all 
the other high-end applications develop¬ 
ers who were never constrained to devel¬ 
op for only one operating environment 
and who want to grab a piece of that vast 
untapped market. You think Microsoft 
wouldn’t have already been doing that if 
there was any money in it? 

This Justice Department recommenda¬ 
tion shows no promise of remedying any¬ 
thing; it seems punitive, nothing more, 
nothing less, and, as such, serves only the 
interests of civil servants who want to jus¬ 
tify their jobs, self-aggrandizing politicians 
who want to monopolize the limelight, 
and Microsoft’s competitors who want a 
government-subsidized advantage with¬ 
out working for it. The rest of us will be 
better off if hizonner da judge sentences 
Gates and Ballmer to community service 
and forgets this whole breakup thing. 

Next month, I quit complaining (until 
next year) and get back to programming. 

DDJ 
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JAVA Q & A 

What's Object 
Pooling All About? 


Alexandre Sieira Vilar 


I n languages such as C and C++, object 
allocation and deallocation can be ei¬ 
ther implicit or explicit (see Listing 
One). Allocation and deallocation oc¬ 
cur implicitly when objects are declared 
as local variables in C++ functions. The 
compiler is then responsible for allocat¬ 
ing the object, and also for deallocating it 
when the function returns. Explicit allo¬ 
cation and deallocation use the new and 
delete operators. 

Java, on the other hand, has only one 
object allocation and deallocation poli¬ 
cy. Objects are created explicitly with 
the new operator, but there is no corre¬ 
sponding delete operator. The release of 
unused memory always occurs implicit¬ 
ly. An object is deleted only when the 
garbage collector detects that there are 
no references to it. 

Each of the two approaches has pros 
and cons. The two C++ approaches allow 
for more flexibility and tighter memory 
control. On the other hand, practice shows 
that lots of discipline and experience is 
necessary to avoid problems such as mem¬ 
ory leaks and pointers to unallocated re¬ 
gions of memory. 

Garbage collection solves the afore¬ 
mentioned problems. On the downside, 
garbage-collected languages have a ten¬ 
dency to use more memory, on average, 
than languages that allow explicit deal¬ 
location. Another disadvantage is that 


Alexandre is a computer engineering stu¬ 
dent at PUC-Rio in Brazil. He can be con¬ 
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the execution of the garbage collector 
introduces random pauses during the 
lifetime of applications. 

The typical Java application simply uses 
all the memory available in its heap until 
no more allocations can be made. At that 
point, the Java run time executes the 
garbage collector to free as much memo¬ 
ry as possible. If not enough memory is 
obtained to honor the allocation request, 
the heap size is increased. 

The execution time of the garbage col¬ 
lector is directly proportional to the num¬ 
ber of currently allocated objects in the 
heap. During garbage collection, the ap¬ 
plication is completely frozen. In addi¬ 
tion, applications in which precise timing 
plays an important role, such as multi- 
media or real-time programs, suffer great¬ 
ly from the unpredictable pauses intro¬ 
duced by garbage collection. Applications 
that keep data structures with a large 
number of allocated objects in memory 
are slowed down, as the garbage collec¬ 
tor lakes a long time to walk the heap on 
each execution. 

Object Pools 

The use of object pools in Java aims to re¬ 
duce the number of garbage-collection iuas 
during the lifetime of a Java application. 

There are several classes in the Java 
standard library and on most applications 
with objects that could be reused instead 
of left in the heap waiting for the garbage 
collector. Two examples are java.awt.geom 
.Point2D.Double and java.awt.geom.Rect- 
angle2D.Double. 
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Consider the two Java methods in List¬ 
ing Two. The readRectangle method al¬ 
locates two temporary instances of the 
Point 2D.Double class that will never be 
used outside the scope of the function. 
Every time the readRectangle method is 
called, it will add two unused objects to 
the heap, which will eventually become 
full. This will force the Java Runtime to 
execute the garbage collector. 

Now imagine that the same two in¬ 
stances were used in every execution of 
the method, as in Listing Three. This 
would prevent the method from con¬ 
tributing to the execution of the garbage 
collector. On the other hand, if the read¬ 
Rectangle method is rarely or never used, 
you would have two unused points in 
memory for every instance of GeomPais- 
er. A single, centralized pool of reusable 
objects would solve the problem much 
more efficiently. 

The tecgraf.objpool Package 

My proposed solution to these problems 
is the ObjectPool class, contained in the 
tecgraf.objpool package (available elec¬ 
tronically; see “Resource Center/' page 5). 
It is a centralized, thread-safe repository 
of reusable objects of any class. 

Unlike most object pool implementa¬ 
tions, ObjectPool can be extended to han¬ 
dle all the classes you need. Most imple¬ 
mentations force you to keep a different 
pool for each class you want to manage, 
which is unwieldy. 

Internally, each pooled class has its 
own manager, which is a subclass of 
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ClassManager. The class manager keeps 
a list of available objects, and uses those 
objects in reply to allocation requests. 
If an allocation is requested and the list 
is empty, a new instance is created by 
calling the abstract newlnstance method. 
This new object is then used to fulfill 
the request. Released objects are simply 
added to the list of available objects. 

Listing Five is an example class man¬ 
ager for the java.awt.geom.Point2D.Dou¬ 
ble class. It implements the newlnstance 
method to return a newly allocated in¬ 
stance of jcwa.awt.geom.Point2D.Double. 

It it not necessary, though, to create 
new subclasses of ClassManager for ev¬ 
ery class handled by ObjectPool. There is 
a good portion of reusable classes that 
provide constructors with no parameters, 
also called “default constructors.” For those 
classes, the ReflectionClassManager pro¬ 
vides a working implementation of the 
newlnstance method. 

If the constructor desired for instantiat¬ 
ing the class has one or more parameters, 
it can still be used by providing the pa¬ 
rameter types and values to Reflection¬ 
ClassManager, allowing for even more 
flexibility. 

When an allocation request is issued, 
ObjectPool checks if a ClassManager is in¬ 
stalled for the given class name. If none 
is found, a new ReflectionClassManager 
will be automatically installed, based on 
the assumption that the class has a con¬ 
structor with no parameters. 

Performance 

Evaluation 

Figure 1 shows the compared memory 
usage along the execution of the same 
test program when ObjectPool and new 
are used for memory allocation. It is clear 
that, in this test scenario, the use of the 
object pool prevented all executions of 
the garbage collector, keeping a uniform 
memory usage during the lifetime of the 
program. The test program used for the 
gathering of this data executes a func¬ 
tion that allocates four temporary objects 
and then releases them, such as the 
reaclRectangle example in Listings One 
and Four. 

Allocating and releasing objects in Ob¬ 
jectPool are both 0(1) operations. The ob¬ 
jects are used in a LIFO (last in, first out) 
order, as if in a stack. The principle of lo¬ 
cality mandates that the last object added 
to the free list is probably the most re¬ 
cently used one as well. In practical terms, 
this means it is more likely to be on cache 
memory and less likely to be on secondary 
storage (swap area). It is only logical, then, 
to use that object first for the sake of per¬ 
formance. 

Calling ObjectPool.allocate and Ob¬ 
jectPool.release is only slightly slower 
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(continued from page 124) chines, is in the order of 0.1 milliseconds 

than using new by a constant factor. This per allocation. This delay is due to the 
difference, as measured in the test ma- fact that new is implemented directly by 



Figure 2: Execution time for heavily multithreaded allocations. 


the Java Runtime, in optimized native 
code, as opposed to a Java class. Appli¬ 
cations negatively affected by the 
garbage collector executions, however, 
will find that using ObjectPool will more 
than make up for this difference. 

One weakness of the ObjectPool class is 
that, when a large number of threads are 
performing simultaneous memory alloca¬ 
tions of the same class, there is a serious 
delay due to monitor contention on the 
ClassManager instance. The mapping of 
class names to ClassManager instances, im¬ 
plemented as a java. util.HashMap in Ob¬ 
ject Pool, is another major source of moni¬ 
tor contention. Figure 2 shows a comparison 
of the execution time of the test applica¬ 
tion when an increasing number of threads 
is used, with ObjectPool and new. 

The test in Figure 2 shows a weakness 
in the synchronization instance returned 
by java. util. Collections.synchronizedMapJt 
only allows one thread to access the map 
at a time. The vast majority of accesses to 
the map in ObjectPool are read accesses, 
which could be performed in parallel. Be¬ 
cause the synchronization is based on mu¬ 
tual exclusion, there is a serious perfor¬ 
mance penalty as the number of threads 
increases. 

It must be taken into consideration, 
however, that the threads used for this 
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Figure 3: Multithreaded average memory usage comparison. 



Figure 4: Multithreaded peak memory usage comparison. 


(continued from page 126) 
test spent practically all of their time al¬ 
locating and releasing objects of the 
same class, which contributed to a some¬ 
what unrealistic worst-case scenario. In 
a real-life application, the threads would 
spend most of their time doing their ac¬ 
tual work, so the chance of two threads 
trying to allocate or release objects si¬ 
multaneously would drop considerably. 

Figures 3 and 4 compare the average 
and peak memory usages for an increas¬ 
ing number of threads when using Ob- 
jectPool and new. This comparison lets 
you confirm that the number of threads 
does not affect the benefits of reduced 
memory usage brought by object pooling. 

Conclusion 

Object pooling can be used veiy effec¬ 
tively to reduce the number of garbage 
collection executions in a Java application. 
This reduction may bring l^eneFiLs in terms 
of reduced processor usage and the ab¬ 
sence of the unpredictable delays intro¬ 
duced by garbage collection. Object pool¬ 
ing can also lower the average memory 
usage of an application. 

On the other hand, object pools can 
bring to Java the classic problem of con¬ 
tinuing to reference a released object. This 
forces the programmer to be more care¬ 
ful and thus nullifies one of the benefits 
of garbage collection for the sake of per¬ 
formance. 
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Listing One 

class A { 
public: 

int i; 

): 

// Implicit memory allocation and deallocation, 
void functionl () 

( 

A a; 

a.i = 0; 

) 

// Explicit memory allocation and deallocation, 
void function2 () 

{ 

A *a = new A(): 
a->i = 0; 
delete a; 

) 


Listing Two 

import java.io.*: 
import java.awt.geom.*; 

public class GeomParser 

( 

// Reads a point from the given input stream and stores it in 
// parameter 'pt'. 

public void readPoint( DatalnputStream dis. Point2D pt ) 

( 

double x. y; 
x = dis.readDoubleO ; 
y = dis.readDoubleO: 
pt.setLocation(x, y): 

} 

// Reads a rectangle from the given input stream and stores it in 
// parameter 'rect'. 

public void readRectangle( DatalnputStream dis. Rectangle2D rect ) 

( 


Point2D pi = new Point2D.Double(). 

p2 = new Point2D.Doubled: 
readPoint(dis. pi): 
readPoint(dis. p2): 

rect.setRect(0.0, 0.0. 0.0, 0.0): 
rect.add(pl): 
rect.add(p2); 

) 

) 


Listing Three 

import java.io.*: 
import java.awt.geom.*; 

public class GeomParser 

{ 

Point2D pi = new Point2D.Double0: 

Point2D p2 = new Point2D.Double(); 

// Reads a point from the given input stream and stores it in 
// parameter ’pt’. 

public void readPoint( DatalnputStream dis, Point2D pt ) 

( 

double x. y: 
x = dis.readDoubleO; 

y = dis.readDoubleO: 
pt.setLocation(x. y): 

) 

// Reads a rectangle from the given input stream and stores it in 
// parameter 'rect'. 

// Method has to be made synchronized to avoid thread contention 
// over objects 'pi' and 'p2'. 

public synchronized void readRectangle( DatalnputStream dis. 

Rectangle2D rect ) 


(continued on page 130) 
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(continued from page 128) 

readPoint(dis. pi): 
readPoint(dis. p2): 

rect.setRect(0.0, 0.0. 0.0, 0.0); 
rect.add(pl); 
rect.add(p2): 

) 

) 


Listing Four 

import java.io.*: 
import java.awt.geom.*: 

public class GeomParser 

{ 

// Reads a point from the given input stream and stores it in 
// parameter 'pt'. 

public void readPoint( DatalnputStream dis, Point2D pt ) 

C 

double x. y: 
x = dis.readDoubleO: 
y = dis.readDoubleO; 
pt.setLocation(x, y); 

) 

// Reads a rectangle from the given input stream and stores it in 
// parameter 'rect'. 

public void readRectangle( DatalnputStream dis. Rectangle2D rect ) 

C 

Point2D pi, p2; 

// Obtain instances from object pool, 
pi = (Point2D) 

ObjectPool.allocate("java.awt.geom.Point2D$Double"). 
p2 = (Point2D) 

ObjectPool.allocate("java.awt.geom.Point2D$Double"); 
readPoint(dis. pi); 
readPoint(dis. p2); 

rect.setRect(0.0, 0.0. 0.0. 0.0); 
rect.add(pl); 
rect.add(p2); 

// Objects are no longer needed, release them. 

ObjectPool.release(pi): 

ObjectPool.release(p2): 

) 

) 


Listing Five 

import java.awt.geom.*; 
import tecgraf.objpool.*; 


public final class Point2D_Double_ClassManager 
extends ClassManager 
( 

private Point2D_Double_ClassManager() 

( 

super(); 

) 

public Object newInstanceO 

( 

return new Point2D.Double(): 


) 

static { 

// Installs class manager for java.awt.geom.Point2D.Double 
Obj ectPool.setClassManager( 

"j ava.awt.geom.Point2D$Double", 
new Point2D_Double_ClassManager() 
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ALGORITHM ALLEY 

Alternating 
Skip Lists 

Laurence Marrie 


A lgorithms often require fast dynam¬ 
ic set operations—SEARCH, INSERT, 
DELETE, and SUCCESSOR/PREDE¬ 
CESSOR, to name a few. One rich 
dynamic set interface is std::set , a part of 
the Standard C++ Library. Library' vendors 
typically implement this interface using a 
red-black tree, though other types of bal¬ 
anced search trees can also be used. Im¬ 
plementing any sizable dynamic set in¬ 
terface efficiently can be a daunting task. 

In this article, I describe a different ap¬ 
proach to implementing a dynamic set— 
the alternating skip list (ASL). ASLs are an 
option anywhere that balanced search 
trees are appropriate. I present a useful 
subset of std::set functionality using ASLs, 
and give a basic space/time comparison 
against a typical red-black tree imple¬ 
mentation. If you are developing advanced 
data structures based on balanced trees, 
you will likely profit from the ASL ap¬ 
proach. 

The 1-2 Deterministic Skip List 

Unlike the probabilistic skip list (PSL), de¬ 
scribed by William Pugh in “Skip Lists: A 
Probabilistic Alternative to Balanced Trees,” 
0 Communications of the ACM, June 1990, 
ftp://ftp.cs.umd.edu/pub/skipLists/), de¬ 
terministic versions of skip lists (DSLs) can 
support SEARCH, INSERT, and DELETE in 
logarithmic time in the worst case. ASLs 
are derived from the array form of the 1-2 
deterministic skip list (see “Deterministic 
Skip Lists,” by J.I. Munro, T. Papadakis, 
and R. Sedgewick, Proceedings of the ACM- 
SIAM Third Annual Symposium on Dis¬ 
crete Algorithms , January 1992, which 


Laurence can be contacted at ltmanie@ 
pathcom.com. 

http://www.ddj.com 



serves as the starting point for our dis¬ 
cussion. Figure 1 shows an array imple¬ 
mentation of a 1-2 skip list. 

In array form, a 1-2 DSL can be 
viewed as a size N singly linked list aug¬ 
mented with variable-size nodes. Each 
node contains an array of forward point¬ 
ers of some exponential capacity: for ex¬ 
ample, 2* for /=0,1,2,... Like an unmod¬ 
ified list, one pointer links to a 
SUCCESSOR node. Nodes with two or 
more pointers employ a fraction of the 
remaining pointers as skip pointers. (Not 
all are necessarily used; more on this lat¬ 
er.) The first skip pointer links either to 
the second or third node down. That is, 
it skips over at least one, but at most two 
nodes. This creates another (level 2) 
linked list with fewer nodes. Second (lev¬ 
el 3) skip pointers likewise skip over 
nodes in the level 2 list. The pattern re¬ 
peats to a maximum of L log Nj lists, and 
represents the “balance” or “gap” invari¬ 
ant of the 1-2 skip list. J.I. Munro et al., 
refer to the “height” of a node as the 
number of linked lists in which it is con¬ 
tained. Assuming extra HEADER and TAIL 
nodes 1 higher than the highest ordinary 
node, then “between any two nodes of 
height h(b> 1) or higher there exist either 
1 or 2 nodes of height h- 1.” 

As with PSLs, SEARCH in a 1-2 DSL is 
a matter of efficient forward movement us¬ 
ing skip pointers. INSERT and DELETE in¬ 
volve adding or removing a node, then re¬ 
adjusting node heights until gap invariance 
is restored. Forward iteration is analogous 
to the case of the singly linked list. 

Moving Towards stdr.set 

The 1-2 DSL is not, however, sufficient for 
implementing all of stdr.set. First, you need 

Dr. Dobb’sJournal ' August 2000 


a doubly linked list at level 1 to support 
reverse iteration. Less trivially, some oper¬ 
ations require the ability to move efficiently 
in both directions. For each forward skip 
pointer we could add another to move 
backward, but that increases memory re¬ 
quirements significantly. The approach I 
adopt is to alternate the direction of the 
skip pointers at each level and turn each 
list into a ring. This places the HEADER 
node at both ends, so we’ll call it END from 
now on. Due to gap invariance, you can 
still determine the predecessor node at any 
given level in constant time. 

Another consideration is how to repre¬ 
sent nodes. In C/C++, you can implement 
variable size nodes by exploiting the lack 
of array bounds checking— a common 
PSL technique. That is, one possibility is 
to store both elements and pointer arrays 
contiguously in memory. A second method 
is to use fixed size nodes containing point¬ 
ers to the pointer arrays. The choice is 
easy, given that INSERT and DELETE re¬ 
quire the ability to raise and lower node 
heights. In some cases, this involves ex¬ 
changing one pointer array for another of 
a different physical size. The first approach 
forces us to replace an entire node. Iter¬ 
ators necessarily store pointers to nodes, 
and height adjustments could create dan¬ 
gling pointers. Iterators are not invalidat¬ 
ed when fixed size nodes are used. 

A disadvantage of fixed size nodes is 
that more memory allocatioas are required. 
Nodes and pointer arrays are allocated 
separately, incurring a time cost not pre¬ 
sent with variable size nodes. Since all 
nodes require both a SUCCESSOR and 
PREDECESSOR pointer, but not necessar¬ 
ily any skip pointers, it makes sense to 
store these separately. This saves at least 
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The process repeats until the bottom lev¬ 
el, where the search key is subsequently 
found or determined not to be in the list. 
The search path for 7 in the ASL from Fig¬ 
ure 2 is END, 11, 8, 4, and 7, for exam¬ 
ple. Gap invariance ensures that you nev¬ 
er make more than two comparisons 
before dropping. It follows that search is 
OOog N). 

The motivation for requiring that the 
END node keep even height is simply that 
implementation is easier if the search al- 
Figure 1: Array implementation of a 1-2 skip list. ways begins in the same direction. Ob¬ 

serve also that when implementing 
SEARCH, a subtle optimization is possi¬ 
ble— key comparisons against nodes with 
height greater than the current search lev¬ 
el can be skipped. In such cases, it is al¬ 
ways necessary to drop a level. 

Now that you know how to search top- 
down for an element, you might ask how 
to search bottom-up (an operation not 
found in std::set). That is, can you use an 
iterator as a search finger, or starting point, 
for the search? A poor hint iterator will re¬ 
sult in slower search, but a perfect hint 
promises constant time lookup. To im¬ 
plement search fingers, you need only 
climb levels until you overshoot the ele¬ 
ment you wish to find. You then drop 
Figure 2: An alternating skip list. back down to the bottom, as in the top- 

l_A/2j+l allocations, because pointer ar- down search procedure. In the worst case, 
rays now need to be allocated only for you may ascend to the highest level be- 
nodes with skip pointers. fore dropping. Search beginning with a 

A final modification is to require that END hint iterator is therefore also logarithmic 
is always of even height; the definition of in the worst case, 
gap invariance is changed accordingly. 

With all of the aforementioned changes, Insertion 

the DSL in Figure 1 becomes the ASL in To insert a node, simply search top- 
Figure 2. down and link into the bottom-level list. 

This gives the new node a height of 1. 
The Alternating Skip List If there are now three nodes of height 

The program asl_set (available electron- 1 in a row, increase the height of the 
ically; see “Resource Center,” page 5) is middle node to 2. If this creates three 
an ASL implementation of a dynamic set. nodes of height 2 in a row, raise the mid- 
Two types each of SEARCH, INSERT, and die of these to height 3, and so on un- 
DELETE are implemented. An iterator til gap invariance is restored. In the worst 
class provides for both SUCCESSOR and case, one node is raised at each level, 
PREDECESSOR operations. For clarity, finishing with the END node. Raising 
asl_set is not a Standard C++ container, END is a special case because an in- 
but if you are familiar with the interface crease of 2 is required to maintain even 
requirements, you will be able to make height. The same algorithm applies also 
the necessary changes without difficul- to insertion using a hint iterator, 
ty. With more work, you can even ere- Figure 3 shows the transformations used 
ate a complete implementation of std::set. by the insertion procedure. Figure 4 shows 

the result of inserting 0 into the ASL in 
Search Figure 2. 

It is because the search path changes di- Increasing the height of a node is 
rection at each level that I named this straightforward. If the node height is less 

modified 1-2 DSL the “Alternating Skip than the physical capacity of the skip 

List.” Search in an ASL involves following pointer array, simply increment the height 

the second-to-top level list until you en- variable (which is stored in the node) and 

Figure 3(a) Raising X, the middle of counter the END node or a node with el- link into the list of the same level. If in- 

three nodes in a row (may leave X or ement >= the search key. You then drop stead the node height is equal to the ca- 

Y as a middle node); (h) raising the a level and continue in the opposite di- pacity of the array, copy the pointers over 

END node. [Cases not shown are rection until you reach the END node or to a new array of mice the size— the rest 

analogous to (a).] a node with element <= the search key. is the same as in the First case. The growth 
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factor is not required to be 2, but it is im¬ 
portant that the skip pointer arrays in¬ 
crease exponentially in capacity. To see 
this, suppose node heights always 
equaled the physical sizes of the skip 
pointer arrays. No skip pointers would 
be unused, but in the worst case you 
would end up copying 1+2 +...[_logN+2] 
pointers, resulting in an 0(log 2 N ) inser¬ 
tion cost. The worst case improves to 
O(logN) if array sizes increase exponen¬ 
tially since most raisings will then take 
constant time. 

A failure to allocate memory during the 
raising procedure would prevent the 


restoration of gap invariance. A remaining 
consideration is therefore error handling. 
The easiest remedy is to preallocate as 
many skip pointer arrays as necessary to 
handle die worst case. If the preallocation 
step fails, a new node is not created and 
the structure stays gap invariant. Adding a 
preallocation step is as simple as main¬ 
taining a free list of skip pointer arrays in 
increasing order of size. In addition, this 
provides a substantial speed improvement 
by eliminating many calls to the memory 
manager. When a larger skip pointer ar¬ 
ray is required, a replacement is removed 
from the free list and the discarded array 


Spiritual 

Robots 



By 2100 computers 
may display traits 
and evidence of 
intelliyence 
that we usually 
only associate 
with humans. 

Symposium organized 
and moderated by 
Doug Hofstadter. 
With presentations 
by Frank Drake, 
Doug Hofstadter, 
John Holland, Bill Joy, 
Kevin Kelly, John Koza, 
Ray Kurzweil, 
Ralph Merkle and 
Hans Moravec. 
Produced in 
partnership with 
The Stanford Channel 
and Stanford 
University's Symbolic 
Systems Program. 




Figure 4: Inserting 0 raises heights of 1 and 4. 



Figure 5: (a) Lowering X and raising Y (gap invariance is restored); (b) 
toweling X [Y becomes X in (a), (b), or (c)J; (c) toweling X (gap invariance is 
restored); (d) toweling the END node. [Cases not shown are analogous to (a), 
(b), or (c)J 
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is added. The effect is to iterate over the on. In the worst case, the skip pointer ar- invariance is finally restored, the last ar- 

free list, always returning all but the last ray of the highest node will be passed to ray discarded is added to the free list. 

array requested. One call to the memory a neighbor, and one node will be lowered If the free list already contains an array 

manager then restores the free list to its at each level finishing with the END node, of this size, it is simply returned to the 

previous state. In the worst case, the pre- As with raising, lowering END is a special memory manager. 

allocation step consists of both this call case because a decrease of 2 is required 

and allocating one new array to compen- to maintain an even height. Note that since Comparing Efficiency 

sate for a raised END node. gap invariance is restored bottom-up, the Tables 1 and 2 show basic space and “wall 

same algorithm applies to deletion with clock” time measurements for asl_set and 
Deletion an iterator argument. a red-black tree implementation of stcl::set. 

To delete an element, search to find the Figure 5 shows die transformations used Integers from 0 to N were inserted in ran- 
node to be removed. If the node has by the deletion procedure. Figure 6 shows dom order, searched for, and then delet- 

height greater than 1, lower it to 0 by pass- the result of deleting 19 from the ASL in ed. The insertion and deletion algorithms 

ing the skip pointer array to its SUCCES- Figure 2. for die red-black tree are based on those 

SOR or PREDECESSOR node and updat- It is easier to lower node heights than in Introduction to Algorithms, by Thomas 
ing all predecessor skip pointers. Finally, to raise them because we do not need H. Cormen, Charles E. Leiserson, and 

unlink from the bottom-level list. If there to worry about memory allocation. To Ronald L. Rivest (McGraw-Hill, 1990). The 

are now two nodes with heights greater lower the height of a node, simply test environment did not include virtual 

than 1 in a row, lower one of them from decrement the height variable. If the memory. 

2 to 1. If this creates three nodes of height node height is now equal to one half The times for asl_set are faster than 
1 in a row, finish by raising the middle of the capacity of the array (assuming a those of the red-black tree, though the 

these—gap invariance is restored. If there growth factor of 2), copy the pointers numbers recorded give only a limited ba- 

remain two nodes with heights greater over to a smaller array exactly one half sis for comparison. The red-black tree uses 

than 2 in a row, lower one from 3 to 2. If the size. It is easy to see that like inser- a memory pool to improve performance, 

this creates three nodes of height 2 in a tion, the deletion algorithm is O(logN). for example. A more comprehensive time 

row, finish by raising the middle node. Each time a smaller skip pointer array comparison is beyond the scope of this 

Otherwise, check for two nodes with is required, the previous one released article, so I’ll state only that ASL algorithms 

heights greater than 3 in a row, and so is used as the replacement. When gap appear to be competitive. 

cisljset compares less favorably in terms 
of space. It is clear that asl_set uses more 
memory than die red-black tree. The dif¬ 
ference is actually even greater than re¬ 
ported, however. ASLs make more calls to 
die memory manager dian balanced search 
trees in general, incurring additional space 
overhead not recorded in Table 2. When 
a typical allocator receives a request for a 
block of memory, a slighdy larger amount 
is reserved. The extra space stores the size 
of the block (and perhaps odier informa¬ 
tion) for later use if it is released. Since 
ASLs require many small arrays of fixed 
sizes, this additional space overhead quick¬ 
ly adds up. This suggests that space re¬ 
quirements can be reduced by using a 
memory pool. In addition, one could 
choose to store node heights togedier widi 
the skip pointer arrays. 

Summary 

I have described a data structure based 
on the array form of the 1-2 determin¬ 
istic skip list. Readers may not be sur¬ 
prised to discover that there is a one-to- 
one correspondence between ASLs, 1-2 
DSLs, and 2-3 trees (a type of balanced 
search tree). ASLs happen to offer the 
same flexibility and complexity guaran¬ 
tees as balanced search trees, but have 
algorithms that are easier to express it¬ 
eratively. They may therefore prove a 
worthwhile addition to your program¬ 
ming toolbox. 


DDJ 



Figure 6: Deleting 19 lowers 16 and 11, and raises 8. 



N 

SEARCH 

INSERT 

DELETE SEARCH Comparisons 

ASL 

10,000 

0.1444(1.0) 

0.2444 (1.0) 

0.25 (1.0) 

14.8138N 


50,000 

0.9166(1.0) 

1.4888 (1.0) 

1.5777 (1.0) 

17.2687N 


100,000 

1.5944(1.0) 

3.4611 (1.0) 

2.5888 (1.0) 

18.1004N 

red 

10,000 

0.1444 (1.0) 

0.2611 (1.0) 

0.3777 (1.51) 

14.67N 

black 

50,000 

0.9166 (1.0) 

1.55 (1.04) 

2.0444(1.29) 

18.3545N 

tree 

100,000 

1.7388(1.09) 

3.4 (0.98) 

4.0 (1.54) 

19.4433N 


Table 1: Time comparison (in seconds, with relative times shown in parentheses). 



N 

Allocations 

Bytes 

ASL 

10,000 

1.4297N 

23.3279N 


50,000 

1.4183N 

23.2439N 


100,000 

1.4137N 

25.5202N 

red- 

10,000 

0.0102N 

20.4420N 

black 

50,000 

0.0099N 

20.1134N 

tree 

100,000 

0.0098N 

20.0724N 


Table 2: Space comparison after N insertions. 
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IMAGE 

FILE 

FORMAT 

SUPPORT 

IMPORT 

EXPORT 


WC++ 


C++ Builder Delphi 


CflPB C++ Class Library ActiveX VOL 


LEAD Technologies has ten years of experience developing digital imaging technology and creating programming toolkits for 
the development community. Over those ten years we have created imaging technology that is currently used by Microsoft, 
Intel, Hewlett Packard, Eastman Kodak, Reuters, Corel and many other world class companies. The years of experience we 
have gained developing imaging technology and solving programmer's problems have produced the engines listed below. Visit 


RASTER 

JPEG 
-Lossy 
-Lossless 
MPEG 
JBIG 
PNG 
SGI 
PSD 
PCD 
EXF 
FPX 
EPS 
I OCA 
MODCA 
BMP 
DIB 
ICO 
CUR 
ANI 
CLP 
PCX 
DCX 
IMG 

RAW FAX 

WFX 

MAC 

TGA 

RAS 

PCT 

CMP 

OS/2 BMP 

AWD 

IFF 

XPM 

XBM 

CUT 

GIF* 

DICOM 
CALS 
WAN 
WPG 
WMF 
EMF 
AVI 
FLC 
MSP 
RLE 
PNM 
PBM 
PGM 
PPM 
XWD 
TIFF 6.0 
•Multipage 
-JPEG 
-Packbits 
-Huffman 
-RLE 
-LZW 
-CCITT 
-CCITT G31D 
-CCITT G32D 
-CCITT G4 
-RGB 


our web site for full details on available LEADTOOLS products which utilize these powerful engines. 



.leadtools.com 


JNE DEMOS 
OWN LOAD FREE EVALS 
r IDEO CODECS 
CONSULTANTS LINKS 
IMAGING PRODUCTS 


Raster Imaging Engine 

Import and export 60+ raster file formats - Supports a wide range of 
compression options, bit depths (up to 64) and color spaces. Progressive and 
non-progressive modes, multi-page, animation and non-image data. 

Image processing - Transforms- resize, rotate, linear and bicubic 
interpolation, flip, invert, reverse, crop, underlay, shear, transpose, auto 
deskew and combine. Filters - sharpen, intensity, saturation, histogram, 
posterize, median, edge, noise and more. Spacial filters - gradient, laplacian, 
sobel, prewitt and more. 

Display - scroll, scale with interpolation, dither, contrast, brightness, with a 
choice of over 2,000 special effects. 

Also includes scanning (TWAIN), capture, printing, screen capture, imaging 
common dialogs, thumbnail browser, image list, Internet and database 
imaging functions and much more! 

Medical Imaging Engine 

DICOM 3.0 - Supports the latest specs, including all standard IOD classes 
and modalities (CR, CT, MR, NM, US, RF, SC, VL, Worklist, etc.) and DICOM 
directory. 

DICOM communications protocol - COMPLETE support including all 
Service Classes (Verification, Storage, Query/Retrieve, Patient 
Management, etc). High-level communications functions to simplify the 
creation of DICOM client/server applications. 

Optimized image processing - the richest in the industry supporting 
1,2,3,4,5,6,7,8,12,16,24 and 32 bit images. Includes 8-16 bit grayscale 
display with window leveling and LUT support. 

Also includes Medical specific annotations like cross product, point and 
protractor, allowing the measuring and mark-up of medical files. 

Internet Imaging Engine 


Document Imaging Engine 

Powerful annotation capabilities - enable the addition of text, highlights, 
sticky notes, audio, ellipses, buttons, lines, arrows, rectangles, polygons, 
redaction, hotspots, freehand scribble, pointers, bitmaps, stamps, rulers and 
hyperlinks all with user-defined security features. 

Document Image processing and Clean-up- Despeckle, deskew, inverted 
text, removal of dots, blobs, lines, borders, hole punches, character smooth. 
Region of interest, preview of changes and composite viewing of the modified 
regions. 

Optimized viewing of bitonal images - Specialized display filters including 
FavorBlack and ScaleToGray, bilinear and bicubic interpolation. 

Also includes ultra-fast CCITT G-3, G-4 and rotation, JBIG compression and a 
pan-window. 


Vector Imaging Engine 

Import/export - DWG, DXF, EMF, WMF, CGM, DGN, DRW, HPGL, HPGL2, 
PICT and LEAD VEC (LEAD’S proprietary file format) in native form. 

Editing -14 different primitive object types (Vertex, line, rectangle, polyline, 
polybezier curve, polygon, ellipse, circle, arc, text, pie, chord, polydraw, and 
raster). Group objects into layers, copy or move objects between layers, lock 
individual layers. Add, edit, delete, rotate, translate and scale objects and 
layers. Convert points from world space to screen space and vice versa. Pixel 
accurate hit testing. 

Also includes 3-D viewing (lighting, shadow, camera), 3 vector engines (GDI, 
OpenGL and DirectX), convert or overlay vector drawings to any LEAD 
supported raster format. 


Multimedia Imaging Engine 


-Palletized 

-Grayscale 

•Bitonal 

-CMYK 

-YCbCr 

-CIELAB 


Support for client server development over the Internet or LAN - 

Provides a framework for sending /receiving commands (LOAD, SAVE, 
CREATEWIN, etc.) from one computer to another. 

Small ActiveX controls and COM objects - Provides LEADTOOLS raster 
imaging functionality in Internet applications. 


Play, Edit and Save - The most comprehensive support of multimedia 
formats including AVI, WAV, MIDI, SND, AIF, AIFC, MPEG-1, MPEG-2 files. 
Capture - capture multimedia data from any Video for Windows or 
DirectShow capture device. 


VECTOR 

WMF 

EMF 

DXF 2-D 

DXF 3-D 

DRW 

DWG 

CGM 

DGN 

HPGL 

HPGL2 

PICT 


30-DAY MONEY BACK GUARANTEE 

‘License required from Unisys (or formats using LZW compression. LEAD 
and LEADTOOLS are registered trademarks o( LEAD Technologies, Inc. ISIS® is a 
reg stered trademark of Pixel Translations, a division of Input Software. Inc. All other 
product names are trademarks of their respective owners. LEADTOOLS is available in 
several versions, while not every feature is available in every version, you can easily find 
the toolkit to match your needs by visiting our website. 



www.leadtools.com 

Email: sales@leadtools.com or call 800-637-1853 
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Conference: August 14-17 
Expo: August 15-17 

San Jose, CA 




WORLD EXPO 
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For more information on 
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LinuxWorld Conference & Expo 
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Since the dawn of the computer age, 
operating systems—and the potential to 
unleash the full power of creative pro¬ 
gramming have been kept under lock 
and key by an elite few. Linux—the 
robust OS that utilizes open source 
code — is finally loosening the strangle¬ 
hold of proprietary OS code and the 
LinuxWorld Conference and Expo is 
where Linux visionaries come together 
to unlock the source for open solutions. 


The San Jose conference is only a short 
drive from both San Francisco and 
Silicon Valley and will offer IT profes¬ 
sionals, entrepreneurs, and Linux afi¬ 
cionados a host of networking and enter¬ 
tainment opportunities. The San Jose 
LinuxWorld Conference and Expo prom¬ 
ises to be one of the most exciting Linux 
events of the year and will be an excel¬ 
lent opportunity for individuals to con¬ 
tribute to the development of the revolu¬ 
tionary Linux OS. 


For more information on 
attending, please visit 

www.linuxworldexpo.com 
or call 800.657.1474. 
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Attend These Dynamic 
Technology Paths: 

• E-Commerce Architecture 

• Windows DNA 

• C++ 

• COM+ 

• XML 

• Linux/Open Source 

• Java 

• Xtreme Programming 

• And more... 


Register Today! 
www.saexpo. com 

or call (800)-441-8826 for more info 


Software Development2000 Conference: 


Oct. 29 - Nov. 2 • Expo: Oct. 31 - Nov. 1 
Washington Convention Center, Washington, DC 


J 


As a serious software developer 
or manager, you know that effective, 
cost efficient solutions are expected 
yesterday. Attend SD 2000 and stay 
one step ahead of the game. 
Enhance your success by acquiring 
critical development skills and gaining 
the knowledge you need to advance 
in this high-speed environment. 


Join us at SD 2000 and rejuvenate, 
gain a new perspective and maybe 
even be inspired. 
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HTML! 
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all the issues of Dr. Dobb's Sourcebook 
on one CD-ROM! Every Programming 
Paradigms, every Algorithm Alley, 
every column, every bit of source 
code from January '88 to December 
'99, all at your fingertips. 


Dr. Dobb's/CD Release 8 brings 
together more than eleven years 
worth of perspectives and expertise from the most respected programmers 
in the industry. Since Dr. Dobb's Journal is written by programmers, for 
programmers you receive the news and views from inside the industry. 

Dr. Dobb's/CD Release 8 offers both long time and first-time readers an 
invaluable programming resource. 


Stop thumbing through back issues for the article you need. Avoid errors in 
re-keying source code, that you can copy and paste directly into your new 
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DR. ECCO'S OMNIHEURIST CORNER 



Dennis E. Shasha 


T he warden was a gray-haired man 
with smile wrinkles. The friendly pas¬ 
tor look and manner failed to match 
my image of the guardian of violent 
criminals. His companion, by contrast, had 
a hard face locked in permanent scowl. 
He introduced himself only as “From the 
FBI,” but volunteered neither name nor 
badge. 

In any case, the warden began the con¬ 
versation: “Cliff River is our state-of-the- 
art federal prison for high-security pris¬ 
oners. Our guards are robots to eliminate 
any chance of corruption. People back up 
the guards with video monitors. There is 
a river on the south side that is impass¬ 
able to boats and would drown the 
strongest swimmer. There is a cliff on the 
north side with a wall in front of it. The 
east and west sides have two rows of rolled 
barbed wire. Yet prisoner Doe apparent¬ 
ly slipped out of his cell, traversed at least 
19 others, and jumped off the cliff on the 
north side to safety with a parachute.” 

“Worthy of James Bond,” 12-year-old 
Liane volunteered, one leg over the arm 
chair. 

“Right, young lady, except this is a bad 
guy,” the warden said. “He’s blown up six 
buildings and killed scores of people. Dur¬ 
ing the trial, we suppressed publicity for 
fear of making people panic.” 

“Whenever I see lots of human guards, 
each one assumes the other has taken care 


Dennis, a professor of computer science at 
New York University ; is the author of The 
Puzzling Adventures of Dr. Ecco (Dover, 
1998); Codes, Puzzles, and Coaspiracy (WJH. 
Freeman & Co., 1992); Database Tuning: A 
Principled Approach (Prentice Hall, 1992); 
(coauthored with Jason Wang and Bmce 
Shapiro) Pattern Discovery in Biomolecular 
Data: Tools, Techniques, and Applications 
Oxford University Press, 1999); and (coau¬ 
thored with Cathy Lazere) Out of Their 
Minds: The Lives and Discoveries of 15 Great 
Computer Scientists (Springer Vetiag, 1998). 
He can be contacted atDrEcco@ddj.com. 

http://www.ddj.com 


of me and I can usually walk through un¬ 
molested. The motto seems to be: ‘The 
more apparent security, the less real se¬ 
curity,’” Ecco observed. 

“Practically no security whatsoever,” the 
FBI man growled. 

“We think it should have been very se¬ 
cure,” the warden said, trying not to sound 
defensive. “Let me tell you more about the 
prison. It is organized as a one story ma¬ 
trix: 20 north-south rows and 35 east-west 
columns. Each prisoner is in a cell block 
by himself. The cell blocks themselves are 
concrete rectangular blocks so the pris¬ 
oner cannot see outside into the hallway. 
He has a bed, a toilet, and a bare light 
bulb. Books are permitted only on good 
behavior.” 

“The constitution allows this?” Ecco 
asked, his cheeks reddening. The FBI man 
looked at Ecco with narrowed eyes. 

The warden seemed to ignore the com¬ 
ment and went on: “The Five robot guards 
are in constant patrol to check that no cell 
block door has been opened. They start 
at midnight, one at the west side of rows 
4, 12, and 20, and one at the east side of 
rows 8 and 16. The prisoner was at cell 
(10,1) to start with. So, he was on the 
south side and had to get to the north side 
without being seen by the robots. 

“Now for the timing. The robots pro¬ 
ceed across (the west ones go east, the 
east ones go west), then when they cross 
completely, they go down one row, then 
they cross back, and so on for four rows, 
at which point, they return to their start¬ 
ing point. So, the southern-most robot 
starts at (1,4) (see the tick mark), crosses 
to (35,4), then goes to (35,3), then cross¬ 
es to (1,3), then (1,2), and crosses to (35,2), 
then to (35,1), and crosses to (1,1) and 
then returns to (1,4). Since it checks each 
door, altogether it is checking 4x35 or 140 
doors. It takes 10 seconds per door and 
40 seconds to travel between rows, so it 
completes the whole task in 24 minutes. 
Figure 1 shows what happens after 1 
minute. (Each robot lias visited six doors.)” 

Dr. Dobb's Journal, August 2000 


“But wait,” said Liane, “It looks as if the 
robots have passed only five rooms.” 

“Nice observation, young lady,” the war¬ 
den said. 

“The cells are the narrow line segments 
pointing north-south. The north-south cor¬ 
ridors are very wide, whereas the east- 
west ones are very narrow. So, you should 
count each verticle line segment as a cell. 

“While the robot moves east or west, it 
can sense anything that moves down the 
hallway and will shoot it (that’s why we 
can’t have more than one robot in a hall¬ 
way at the same time). It cannot see back¬ 
wards or sideways, however. The prison¬ 
er moves faster: five seconds per block 
going north or south and two seconds per 
block going east or west. 

“At first, we figured that the prisoner 
must have escaped by going directly north, 
because he broke through the wall at po¬ 
sition (10,20). But in that case, he would 
have had to wait until the west-moving 
robot at row 4 reached position 10 (100 
seconds), then the east-moving robot at 
row 8 reached position 10 (250 seconds), 
and then he’d be able to dash for the top 
without waiting further, reaching it at 310 
seconds. But in fact, we have evidence to 
show that he reached the top in under 
four minutes. How is this possible?” 

Liane and Ecco conferred. They talked 
in hushed voices and then Liane giggled, 
passing her hand through the hair on the 
back of her uncle’s head. “That’s what he 
must have done,” she said. Soon after, she 
produced a solution. 

Reader; Would you like to try to find the 
shortest time, after midnight, the prisoner 
could have reached the north side? Liane 
was able to get the prisoner out before 
12:03:35 . 

The FBI man snatched the solution, 
grunted, and stormed out of the room. 
The warden smiled, “He has a reason to 
be unhappy. His job is antiterrorism. This 
Doe will be caught I’m sure, but I need 
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your help to make sure this never hap¬ 
pens again. I still want all ceil blocks 
checked every 24 minutes, but can I re¬ 
organize the routes and/or timing of the 
robots in such a way that escape becomes 
impossible? Note that two robots will shoot 
each other if they see each other except 
when they are going north or south.” 

I never heard the answer to that one. 

Reader: Is there any way to reorganize 
the robots so they visit every prison door 
eveiy 24 minutes while completely elimi¬ 
nating the chance of escape and avoiding 
shooting one another? 

Last Month's Solution 

Here is Ecco’s ordered list. This wordsnake 
has a score of 357. 

invent 

tense 

seem 

emerge 

merger 

geriatric 

tricky 

yes 

essential 

ally 

yet 

eternal 

alas 

lasting 

stinger 

gerund 

underdevelop 

eloped 

pediatric 

trice 

icer 

certain 

incredible 

blemish 

mishapen 

penultimate 

terrible 

blend 

lending 

ingrate 

rates 

tessilate 

later 

terrestrial 

trials 

sudden 

denude 

dense 

sea 


Figure 2 is the wordsnake in long form. 
Here is the list that yields an 18 letter se¬ 
quence in long form: 

antiestablishment 

establishment 

establishments 


Reader Notes 

Several readers objected to my use of the 
prefix “centi” to mean hundreds as op¬ 


posed to hundredths in “CentiMillionaires” 
(DDJ , May 2000). The correct prefix is 
“hecto.” Readers who discovered this bug 
include: Rich Mickelsen, Michael Mc¬ 
Cormick, Jan Vanderbrugge, Lloyd Rice, 
Chad Harrington, Peter Hornby, and Dale 
R. Sinclair. I appreciate the correction and 
note its consistency with words like 
hectare and centimeter, though I wonder 
what they think of words like centipede, 
century, or centennial? 

As for alternatives to Liane’s solution, Oleg 
Kiselyov suggests a “weird cross-over 1 be¬ 
tween RSA and Diffie-Hellman key ex¬ 
change” that requires only 58 messages and 
can be done over a broadcast medium with¬ 
out loss of security. It works by having Cl 
send information to C2, C2 to C3 up to C20, 
then C20 sends information to Cl and Cl 
starts anew. At the end, C20 broadcasts the 
answer. For details, look at http://pobox 
.com/~oleg/ftp/secure- count.html. 

Jason Strickland suggested a cryptography- 
free protocol: “In the annual meeting let¬ 
ter that goes out to the Centimillionaires 
direct them to disable caller ID and call a 
certain phone # and say how many cen- 
timillions they have. The phone could be 
a 3rd party (to alleviate voice recognition 
concerns). Or, they could simply enter their 
wealth by pressing the value in centimil- 
lions on the Telephone pad (1-100) (fol¬ 
lowed by # or whatever). Which could be 
decoded by modem, etc.” My worry was 
the disabling assumption, but this too was 
very clever and required just 20 phone calls. 
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Figure 1: Escape, after 1 minute. 



Figure 2: Wordsnake solution from last month. 


142 


Dr. Dobb’s Journal, August 2000 


http://www.ddj.com 



































































































Visit our web site for all the products 
from Dr. Dobb’s CD-ROM Libraty: 


www.ddi.com/cdrom/ 




ALGORITHMS 

and .DaiA.SmictmKS 


N 

RELI 


Dr. Dobb’s/CD Release 8 CD-ROM 

Dr. Dobb's/CD Release 8 contains over 11 years of cutting-edge computer information. Including 
over 136 issues of Dr. Dobb's Journal plus all the issues of Dr. Dobb's Sourcebook on one CD-ROM! 

Every Programming Paradigms, every Algorithm Alley, every column, every bit of source code from January 
'88 to December'99, all at your fingertips. 



Dr. Dobb's/CD Release 8 brings together more than eleven years worth of perspectives and exper¬ 
tise from the most respected programmers in the industry. Since Dr. Dobb's Journal is written by 
programmers, for programmers, you receive the news and views from inside the industry. Dr. 
Dobb's/CD Release 8 offers both long time and first-time readers an invaluable 
programming resource. 

PRICE* $79 95 C Upgrade available to prior ownerslTo upgrade call: 800-822-1162 J 


Dr. Dobb’s Essential Books on Algorithms and Data 
Structures Release 2 CD-ROM 

There's nothing more fundamental to programming than algorithms and data structures.Your CD- 
ROM includes nine of the most important books ever written for programmers about the subject. 

These books give you proven and trusted ways to analyze and solve problems in C, C++, and other 
languages.Take advantage of the research and testing that went into developing the algorithms and data 
structures included on this CD-ROM! 

Master practical programming techniques. Ensure that your programs are understandable, maintainable, and 
efficient-even as they grow in size.The right data structure can make your operations simple and 
efficient, the wrong one can make an operation cumbersome and slow. 



PRICE! $79.95 

INCLUDESTHESE BOOKS: 

Chosen by the Editors of DDJ: 

1. Data Structures: From Arrays to Priority 
Queues by Wayne Amsbury 

2. Introduction to Algorithms by Thomas H. 
Cormen, Charles E. Leiserson, and 
Ronald L. Rivest 


Powerful cross-platform search engine locates information fast across all books! 


3. Information Retrieval: Data Structures and 
Algorithms edited by William B. Frakes and 
Ricardo Baeza-Yates. 

4. Fundamentals of Data Structures 
by Ellis Horowitz and Sartag Sahni 

5. Reliable Data Structures in C by Thomas Plum 

6. Data Structures and Algorithm Analysis in C 
by Mark Allen Weiss 


7. Practical Data Structures in C++ by Bryan Flamig 

8. Data Structures , Algorithms and Program Style 
Using C by James F Korsh and 

Leonard J. Garrett 

9. Data Structures and Algorithms by Alfred V. 
Aho, John E. Hopcroft and Jeffrey D. Ullman 

Plus more than a dozen articles related to 
algorithms from Dr. Dobb's Journal! 



c 


$29.95 Upgrade available to prior ownerslTo upgrade call: 800-822-1162 



Dr. Dobb’s Alternative Programming Languages Release 3 CD-ROM 

Back by popular demand! The Alternative Programming Languages Release 3 CD-ROM is your definitive 
resource for cutting-edge programming environments, giving you access to the most innovative, solution¬ 
providing languages and tools available today. 

This new release contains the most comprehensive collection of programming languages ever assembled 
with over 600 megabytes of data! 

The Alternative Programming Languages Release 3 CD-ROM will get you up to speed with languages and 
docs for Squeak, Dylan, Mozart, Octave, SatherK, Haskell, Lua, EiC, Small Eiffel, Erlang, Modula3, Standard ML 
of New Jersey and more! 


$19.95 Upgrade available to prior ownerslTo upgrade call: 800-822-1162 


ORDER TODAY! 800-992-0549 

All Other Countries: 785-841-1631 Mail Orders: Dr. Dobb's CD-ROM Library 

E-mail: orders@mfi.com 1601 West 23rd St., Suite 200 

Fax Orders: 785-841-2624 Lawrence, KS 66046-2703 USA 


DnDobb’s 



LIBRARY 


















The Advertiser Inde 


Advertisers Name 


Abraxas Software, Inc 

■www.abxsoft.com 


111 


Acumen Systems, Inc. 

www.acumensoft.com 


96 


Addison Wesley 

www.awl.com/cseng/ 

Addison Wesley 

www.awl.com/cseng/ 

AGFA Monotype 

www.agfamonotype.com 

Aladdin Knowledge Systems 

www.aks.com 

AICS 

www.cs.aics.edu 

Amzi! Inc 

www.amzi.com 


44 


65 


24 


13 


149 


149 


Apple 

www.filemaker.com 


C2-1 


Araxis, Ltd 

www.araxis.com 

Artisan Software Tools 

www.artisansw.com/real 


101 


81 


Bennet-Tec Information Systems 

www.bennet-tec.com 

BitARTS, Ltd 

www.bit-arts.com 


116 


47 


The Blue Square Group 

lwww.codemagiccd.com 

Blue Water Systems 

jwww.bluewatersystems.com 

Boeing 

| www.boring.com/employment 

ibSquare Corp 

iwww.bsquare.com 

Cambridge University Press 

■www.cup.com 

! Catenary Systems 

I www.catenary.com/victor 

| Centura 

Iwww.centurasoft.com 

Charles River Media 

I www.charlesriver.com 

Colorado Software Summit 

lwww.SoftwareSummit.com 

iComponentSource, Inc 

Jwww.componentsource.com 

| Computer Associates 

lwww.cai.com 

Compuware/NuMega Labs 

lwww.compuware.com 

I Dell 

[www.dell.com 

j Development 

lwww.develop.com 

Devicetop.com 

Ivmvrf.devicetop.com 

DevSoft 

jwww.dev-soft.com 

DICE.com 

Jwww.dice.com 

DDJ Alternative Programming 

3www.ddj.com/cdrom/ 

Cryptography CD-ROM 

| www.ddj.com/cdrom 

DDJ Website 

lwww.ddj.com 

j DDJ Affiliates 

lwww.ddj.com 

DDJ Python 

jvrfww.ddj.com/cdrom/ 

DDJ Numerics CD-ROM 

lwwvrf.ddj.com/cdrom 


64 


94 


59 


95 


68 


149 


78-79 


111 


73 


38-39 


41 


71 


28-29 


100 


84 


115 


88 


110 


126 


130 


90 


147 


121 






Advertisers Name 

Page # 

DDJ CD Release 8 

www.ddj.com/cdrom/ 

140 

DDJ CD-ROM Library 

www.ddj.com/cdrom/ 

143 

esmertec, Inc 

www.esmertec.com 

93 

Espial 

wvrfw.espial.com 

85 

Espial 

www.devicetop.com 

129 

FairCom 

www.faircom.com 

6 

Filemaker 

www.filemaker.com 

C2-1 

Fiorano 

www.fiorano.com 

103 

Gimpel Software 

www.gimpel.com 

51 

Globetrotter Software 

www.globetrotter.com 

112 

Hotdispatch, Inc 

www.hotdispatch.com 

107 

l-Logix 

www.ilogix.com 

61 

l-Logix 

www.ilogix.com 

91 

IBM 

www.ibm.com/developerworks 

69 

IBM 

33 

www.ibm.com/software/soul/smarter 

InformIT 

www.informit.com 

105 

Informix Software 

www.informix.com 

30-31 

Installshield Software Corp 

www.windovrfs2000setup.com 

35 

Iomega 

www.iomega.com 

67 

Kenonic Controls Ltd 

www.crypkey.com 

114 

Kenonic Controls Ltd 

www.crypkey.com 

149 

KL Group Inc. 

www.klgroup.com/great 

23 

KL Group Inc. 

www.klgroups.com/all 

43 

KL Group Inc. 

www.klgroup.com/faster 

122 

Lead Technologies 

www.leadtools.com 

137 

Lineo 

vrfww.lineo.com 

89 

Linux World Conference 

www.linuxworldexpo.com 

138 

Loox Software 

www.loox.com 

27 

Macrovision 

131 

www.macrovision.com/hd_ad.html 

Microquill 

www.microquill.com 

12 

Microsoft 

www.microsoft.com/dna 

55 

Microsoft 

www.microsoft.com/dna 

57 

MKS 

www.mks.com/interop 

132 

Morgan Kaufman 

www.mkp.com 

109 

MSDN Magazine 

magjob@microsoft.com 

92 

National Instruments 

www.ni.com/info/mstudio 

87 




Advertisers Name Page# . Advertisers Name 


148 


77 


72 


Northwoods Software 

www.trulyvisual.com 

Numerical Algorithms Group 

www.nag.com 

Objectivity, Inc 

www.objectivity.com 

Object Mentor 

www.objectmentor.com 

Object Tools 49 

toolandcomponentmarketplace.com 

Omnis Software, Inc 102 

www.omnis-software.com 

Oracle Corp 20 

technet.oracle.com/idevelop 

ParasoftCorp 11 

www.parasoft.com/story_aug.htm 

Parasoft Corp 37 

www.parasoft.com/story_aug.htm 

Pegasus Imaging 114 

wavelet2000.jpg.com 

Perforce Software, Inc 19 

vrfww.perforce.com 

Port Austin 117 

www.portaustin.com 

The Portland Group 50 

www.pgroup.com 

Premia Corp 52 

www.premia.com/overview 

Prentice Hall 24 

www.phptr.com 

Programmer’s Paradise 14-15 

www.pparadise.com 

ProtoView 16-17 

www.protoview.com 

Quadron 149 

www.quadron.com 

Reasoning 83 

www.reasoning.com/dobbstrial.html 

Red Hat 118 

www.redhat.com 

Reliable Software 148 

www.relisoft.com 

RLC Enterprises 149 

www.rlc.com 

Rogue Wave Software 7 

wwvrf.roguewave.com/specials/iqtest2 

Rogue Wave Software 9 

www.stingray.com/win2000 



RSA Security 

wwv/.rsasecurity.com/go/cert 

Sandstone Technology 

www.sand-stone.com 


Softel vdm, Inc. 

www.softelvdm.com 


Software Blacksmiths 

www.swbs.com 

Software Development East 

www.sdexpo.com 

Sparta Systems, Inc 

www.sparta-systems.com 

Starbase 

www.starbase.com/B4U 

Swell Software 

www.swellsoftware.com 


Tal Technologies 

www.taltech.com 


Tall Tree 

www.tall-tree.com 

Teamshare, Inc 

www.teamshare.com 

TechExcel 

www.devtrack.com 

TechNetCast 

www.technetcast.com 

Technosoft 

www.technosoftweb.com 


Tidestone Technologies, Inc 

wvrfw.tidestone.com 


Together Software 

www.togethersoft.com/dd/ 

Troll Tech AS 

www.trolltech.com 

Walnut Creek CD-ROM 

www.slackware.com 

Walnut Creek CD-ROM 

www.freebsdmall.com 

WebGAIN 

www.webgain.com 

Web 2000 Conference 

www.web2000show.com 

WIBU Systems 

www.wibu.com 

Wilson WindowWare 

www.winbatch.com 

WYSE Systems 

www.sentryindia.com 

Zero G Software 

www.ZeroG.com 


Page # 
C3 
121 

96 

148 
139 

45 

53 

124 
92 

149 
2 

99 

135 

148 
127 

3 

75 

62 

63 

C4 

97 
94 

149 
149 

125 


SALES REPRESENTATIVES 


Publisher / Timothy J. Trickett / 650-655-4201 / ttrickett@cmp.com 
Associate Publisher / Brenner Fuller / 603-746-3057 / bfuller@cmp.com 
Advertising Sales Director / Stan Barnes / 650-655-4190 / sb3mes@cmp.com 





NEW ENGLAND/ 

MID-ATLANTIC/ 

WEST 

SOUTHWEST 

NORTHWEST 

NORTH CENTRAL 

SOUTHEAST 

Regional Sales 

Regional Sales 

Regional Sales 

Regional Sales 

Regional Sales 

Manager 

Manager 

Manager 

Manager 

Manager 

Randy Byers 

Ron Cordek 

Michael Beasley 

Phil Marshall 

Michael Kelleher 

650-655-4301 

949-574-0313 

650-655-4304 

978-499-4933 

561-785-6322 

rbyers@cmp.com 

rcordek@cmp.com 

l 

1 

« 

ta 

| 

1 

t ikelleher@cmp.com 


Sales Associate 

Account Manager 

Sales Associate 

Account Manager 


Caroline Oidem 

Gabe Rogol 

Marla Wood 

Linda Guyette 

FAX 

650-655-4323 

650-655-4168 

803-731-0759 

603-924-5971 

650-358-9749 

coidem@cmp.com 

grogol@cmp.com 

mwood@cmp.com 

iguyette@cmp.com 


SOFTWARE CAREERS Lee Somavia / 650-655-4193 / lsomavi 3 @cmp.com 
ONLINE ACCOUNT MANAGER Lilly Gutierrez / 650-655-4306 / llgutierrez@cmp.com 


The index on this page is provided as a service to our readers. The publisher does not assume 
any liability for errors or omissions. 
























PROGRAMMER'S BOOKSHELF 


Python, C++, 
and Other Religions 

Gregory V. Wilson 



£*C/ . The Quick 

Exceptional C++ 

,V " •: r : Python Book 

Herb Sutter 

'• “ V" • Daryl Harms and 

Addison-Wesley-Longman, 2000 

1 “ J Kenneth McDonald 

208 pp., $33.95 

Manning, 2000 

422 pp., $39.95 

ISBN 0201615622 

ISBN 1884777740 

Core Jini 

W. Keith Edwards 

Python Annotated Archives 

Prentice-Hall, 1999 

Martin C. Brown 

772 pp., $49.99 

Osborne/McGraw-Hill, 2000 

722 pp., $49.99 

ISBN 0130114469X 

ISBN 0072121041 

Designing Web Usability 

Jakob Nielsen 

Python Essential Reference 

New Riders, 1999 

David M. Beazley 

419 pp., $45.00 

New Riders, 2000 

319 pp., $34.95 

ISBN 156205810X 

ISBN 0735709017 

Understanding Search Engines 

Michael W. Beny 

Python Programming 

and Murray Browne 

on Win32 

Society for Industrial and Applied 

Mark Hammond 

Mathematics, 1999 

and Andy Robinson 

116 pp., $32.00 

O’Reilly & Associates, 2000 

652 pp., $34.95 

ISBN 0898714370 

ISBN 1565926218 

Toward Zero-Defect 
Programming 

Efficient C++: Performance 

Allan M. Stavely 

Programming Techniques 

Addison-Wesley-Longman, 1999 

Dov Bulka and David May hew 

240 pp., $26.95 

Addison-Wesley-Longman, 2000 

ISBN 0201385953 

309 pp., $34.95 

Game Architecture and Design 

ISBN 0201379503 

Andrew Rollings and Dave Mom's 
Coriolis, 2000 

742 pp., $49.99 

ISBN 1576104257 


I ’ve never tried to cover 11 books in a 
single column before. I’ve also never re¬ 
ceived as many virulent flames as I have 
in the last three months. Since the rea¬ 
son for the flames is also the reason I’ve 
fallen so far behind in my reviewing, and 
the reason I read most of this month’s 
books, I have to start this column by de¬ 
scribing why even the best inventions 
should sometimes be retired, and how a 
project I’m involved in is trying to do that. 

The UNIX command-line toolset was ar¬ 
guably as great an advance in applied com¬ 
puting as Fortran or Smalltalk. Sed, troff, 
and their kin made component software a 
reality for thousands of programmers long 
before the term itself was invented. Any 
good idea that could be expressed as a 
transformation on text streams could im¬ 
mediately leverage, and be leveraged by, 
hundreds of other simple utilities. 

However, as time went by, the initial sim¬ 
plicity of a bt of these utilities was obscured 
by creeping “featuritis.” Make, for exam¬ 
ple, started off as a simple semideclarative 
way to describe dependencies between 
files, but the addition of conditionals, bops, 
macro transformations, and other facilities 
over the last quarter of a century have 
aimed it into an exceptionally clumsy pro¬ 
gramming language. Similarly, vi (the sim¬ 
ple UNIX editor) now has more features 
than early versions of the operating system 
upon which it was developed. The result 
is that mastering these basic tools Is now 
much harder than it needs to lie. 

This isn’t just a personal opinion. Most 
of the scientists and engineers in the soft¬ 
ware engineering classes I teach at Los 
Alamos National Laboratory (LAND have 
graduate degrees in theoretical physics, 
mechanical engineering, or similar disci¬ 
plines. They’re smart, and they’re used to 
working hard. They would like to move 
their programs off specialized supercom¬ 
puters and onto Linux-based clusters, but 


Greg is the author of Practical Parallel Pro¬ 
gramming (MIT Press, 1995), and coedi¬ 
tor with Paul Lu of Parallel Programming 
Using C++ (MITPress, 1996). Greg can be 
reached at guwilson@interlog.coin. 
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their efforts are being frustrated by the 
unnecessary complexity of configuring 
Bugzilla, deleting directories in CVS, quot¬ 
ing shell variables in make, and so on. 

LANL has therefore set up a project 
called “Software Carpentry” (see http:// 
www.software-carpentry.com/), the aim 
of which is to produce a new generation 
of tools that will be easier to use than 
those we have today. To make it easy to 
install these tools, write scripts for them, 
and make them talk to each other, the 
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decision was made to use Python for all 
implementation work. (If there had been 
a simple, lightweight component system 
that ran on both Linux and Windows, it 
would probably have been chosen in¬ 
stead, but Linux implementations of COM 
have been hampered by patent issues, 
and CORBA is neither simple nor 
lightweight.) 

That’s when the flames started. It was 
easy to discount people who thought that 
Software Carpentry was some kind of pro- 
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Python coaspiracy: That’s simply not what 
had happened. I also had a clear con¬ 
science about deleting flames that said that 
{pick a random language] should have 
been chosen instead Feedback from 140 
students over a year and a half convinced 
me that Python was much easier to learn 
than the alternatives, and none of the 
flamers had anything other than personal 
anecdotes to back up their preferences. 

The comments that really bothered me 
were those from people who felt that pro¬ 
grammers ought to be allowed to use what¬ 
ever language they wanted. I agree that it 
would be easier for someone who already 
knows Tel, Perl, or Ruby to write tools in 
those languages than in Python, but what 
alx)ut die poor, often-forgotten user? If you 
want to use all the programming tools that 
come with a full Linux installation these 
days, or use a metatool like autoconf, you 
have to master Perl, Pydion, Tel, Emacs Lisp, 
two major flavors of shell, and several slight¬ 
ly different flavors of regular expressions. 
That is simply too high a price for some¬ 
one who is already mnning as fast as she 
can to stay on die leading edge of fluid me¬ 
chanics research. Advocating it is about as 
sensible as suggesting that online help 
should be written in whatever mix of En¬ 
glish, Esperanto, and Klingon appeals to in¬ 
dividual developers, and betrays a self- 
centeredness that may go a long way to¬ 
ward explaining why so much of today’s 
software is so hard to use. 

So Python it is. If you haven’t looked at 
the language already, it is to Perl or Visual 
Basic what Java is to C++ (but without any 
marketing hype). I expea die previous para¬ 
graphs will engender even more flames on 
die subjea; I promise to read and reply to 
all diose diat are (a) polite, and (b) based 
on something other than personal anec¬ 
dotes, or the kind of “but it’s obvious” ar¬ 
guments that led Aristotle to believe that 
heavy objects fall faster dian light ones. 

Which brings us, finally, to this month’s 
books. The first, The Quick Python Book , 
by Daryl Harms and Kennedi McDonald, 
is an introduaion to the language for peo¬ 
ple who already know how to program. 
The first part of the book covers the lan¬ 
guage’s major features, from simple I/O to 
object- oriented programming. The middle 
of the book describes packages, overload¬ 
ing operators, and regular expressions, wliile 
the last pait explores COM programming, 
interfacing to C/C++, JPython (an imple¬ 
mentation of the language that ains on die 
Java Virtual Machine), and odier specialized 
topics. The writing is clear and, except for 
Chapter 4 (a soup-to-nuts overview of die 
language diat will probably just leave most 
readers confused), well organized. 

Except for its weight, Martin Brown’s 
Python Annotated Archives is a good sec¬ 
ond book on the language. Each chapter 
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is a detailed dissection of a single useful 
script, such as a quick web log reporter or 
a utility that creates a tree of symbolic links 
to mirror an existing directory structure. It’s 
not something you’d want to read all at 
once, but if, like many programmers, you 
learn best from examples, this might actu¬ 
ally be die best way to pick up Pydion. 

Despite starting widi an excellent sum¬ 
mary of the language, David Beazley’s 
Python Essential Reference really is just 
that— a reference. Most of die book is de¬ 
voted to die libraries in die standard Python 
distribution; while I would have liked more 
examples, my main criticism is that much 
of die ground it covers is already adequately 
covered by the online documentation at 
http://www.python.org/. I would have 
found the book more useful if it had ex¬ 
plained more of die things that have a “to 
be written” flag online, and hope that the 
second edition will fill in die missing pieces. 

Mark Hammond and Andy Robinson’s 
Python Programming on Win32 is another 
O’Reilly entry in the crowded field of Win¬ 
dows programming books. This one man¬ 
ages to summarize Python in just six pages, 
before moving on to talk about advanced 
features, particularly support for COM. That 
support makes it possible for Pydion to script 
Excel or Outlook, talk to ODBC databases, 
create Windows NT sendees, and do ev- 
erydiing else that Visual Basic is currently 
used for. Like Perl, I diink that Pydion is a 
good bridge for developers moving from 
UNIX to Windows, and this book will help 
make die transition even easier. 

Despite my growing fondness for 
Python, I’m still writing a fair bit of C++ 
and Java these days. I had thought that 
every nook and cranny of the C++ book 
market was already filled, but Dov Bulka 
and David Mayhew’s Efficient C++: Per¬ 
formance Programming Techniques and 
Herb Sutter’s Exceptional C++ have both 
proved me wrong. The first book is about 
the things that can make C++ programs 
run slowly, and what programmers can do 
to work around diem. It is not only a wor¬ 
thy successor to Jon Bentley’s landmark 
Writing Efficient Programs (which is still 
one of my favorite programming books), 
but also one of the best descriptions I’ve 
ever read of what’s going on under the 
hood in a C++ program. Even if you don’t 
care about speeding up your programs, 
this makes the book well worth reading. 

Sutter’s Exceptional C++ is subtitled “47 
Engineering Puzzles, Programming Prob¬ 
lems, and Solutions,” which is exaedy what 
the book delivers. Want to know how to 
create case-insensitive strings using the 
classes in the Standard Template Library? 
See pages 4-7 for the easy bits, and the 
three pages that follow for a critical look 
at the first solution’s usability. Confused 
about when and how to use exceptions? 
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See items 8 dirough 19. Pointers that will 
manage the memory they point to? That’s 
item 37 (which has a well-deserved diffi¬ 
culty rating of 8). Like Scott Meyers’ Effec¬ 
tive C++ books, Exceptional C++ shouldn’t 
lie anyone’s first book on die language, but 
ought to be read by anyone who expects 
to spend a year or two working with C++. 

Of course, if you ask people what lan¬ 
guage diey expect to be working in a year 
or two from now, many will say Java. Wliile 
it hasn’t lived up to its original “write once, 
run anywhere” promise, it is a solid systems 
programming language that is now sup¬ 
ported by a bewildering variety of libraries. 
One of the most important of diese is like¬ 
ly to be Jini, which is designed to support 
transient, heterogeneous networks—in sim¬ 
ple terms, to let tomorrow’s smart refriger¬ 
ator talk to tomorrow’s smart watch. 

If Jini takes off, Keith Edwards’ Core Jini 
is likely to become the standard reference. 
If that happens, I hope that Addison- 
Wesley will split diis book in two — there’s 
certainly enough material. After some ear¬ 
ly gush (the first chapter actually is called 
“A New Computing Paradigm”), Edwards 
explains what’s wrong with today’s net¬ 
works, and die five key concepts in die Jini 
model: discovery, lookup, leasing (a so- 
pliisticated derivative of time-outs), remote 
events, and database-style transactions. The 
next 15 chapters then go dirough every as¬ 
pect of the Jini API, as well as die simpli¬ 
fied JavaSpaces layer that sits on top of it. 
There’s lots of code (with more white space 
and fewer comments than I’d like), and 
enough examples to show how and where 
different parts of that API can lie used. The 
explanations are clear, but occasionally as¬ 
sume knowledge of other parts of the Java 
world (such as JavaBeans) that some read¬ 
ers may not have. 

If Jini is about how to build networks, 
then Jakob Nielsen’s Designing Web Us¬ 
ability: Tide Practice of Simplicity is about 
what’s wrong with the biggest network 
application in general use today. There’s 
a lot of color in the book, and a lot of 
good advice about how to make web sites 
that people can, and will, use. A lot of ex¬ 
pensive corporate sites would be much 
friendlier if their creators paid attention to 
what Nielsen says about the evils of frames 
and splash screens, or to his simple ex¬ 
planations of why cool ideas such as 3D 
navigation don’t work in practice. Over 
and over, I found myself saying, “Well, of 
course,” and then realizing that I had ac¬ 
tually made the mistake he was describ¬ 
ing. Following die advice in this book isn’t 
guaranteed to make your web site a good 
one, but not following it is almost certainly 
going to make it bad. 

Michael Berry and Murray Browne’s slim 
volume Understanding Search Engines: 
Mathematical Modeling and Text Retrieval, 

http://www. clclj. com 




looks like it was typeset some time in the 
early 1980s, but the technologies it de¬ 
scribes are key to dealing with the biggest 
challenge facing the Web in the 21st cen¬ 
tury. As more and more content and pseu¬ 
docontent becomes available through the 
Internet, we need increasingly more pow¬ 
erful tools for searching and indexing it if 
we are not to find ourselves in the same 
situation as the hapless denizens of Boiges 
Library of Babel. This Ixxik examines both 
the mathematics behind modern infor¬ 
mation retrieval systems, and the nuts and 
bolts of preparing documents, managing 
queries, and responding to feedback from 
users. At 116 pages, it is one sixth the size 
of Core Jin i , but in the long run, it’s like¬ 
ly to prove at least as useful. 

The last two books on this month’s 
lengthy list are both concerned with mak¬ 
ing programs tetter. In Toward Zero-Defect 
Programming, , Allan Stavely describes how 
the Cleanroom practices developed at IBM 
can lead to dramatic reductions in defect 
rates, and long-term maintenance costs. The 
lengthy semiformal invariants and proofs 
that the Cleanroom method requires pro 
grammers to write will seem like overkill to 
many, but only because society keeps let¬ 
ting us sell software that isn’t guaranteed to 
work. Sooner or later, we’re going to have 
to meet the same standards as housing con¬ 
tractors and toaster manufacturers; when 
that happens, I for one will te grateful for 
the simple, straightforward explanations in 
Stavely’s lxxik. 

Finally, there is Game Architecture and 
Design , by Andrew Rollings and Dave Mor¬ 
ris. When I first saw the blurb for tills Ixxik, 
I hoped that the authors had finally given 
me a chance to cross off one of my “Re¬ 
views of Unwritten Books” (http://www 
.ercb.com/feature/feaRire.0012.html). Alas, 
while this Ixxik has some worthy points, it 
tries to do too much. There is definitely a 
market for a book on how to design mod¬ 
em computer games. There is also a need 
for a book on how to manage development 
of game software (although I don’t believe 
that games are as unique in this respect as 
die authors claim in dieir introduction), and 
on how to implement games using C++, 
COM, and odier techriologies. But in trying 
to cram all of this into one book, the au- 
diors have too often sacrificed continuity. 
Poor editing doesn’t help here—diere are 
not only some obvious cut-and-paste typos, 
but different chapters use different dia¬ 
grammatic notations and occasionally con¬ 
tradict one another. I think game develop¬ 
ers are better off reading this book than 
nodiing at all, but diey’d te tetter off still 
to pick up Steve McConnell’s Rapid Devel¬ 
opment. 
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The Dr. Dobb's Python Resource CD-ROM is the best 
I’ available source of Python information you'll find! 

This CD-ROM includes 
Python distributions for 
| platforms ranging from 
tf n 4inux to Win32, and 

applications for 



programmers and end « 

users The CD- 

ROM also includes tutori- 

als, FAQs, and Python articles 

from leading magazines such as 

Dr. Dobb's Journal, Web Techniques, and more! 

Python is a powerful interpreted, object-oriented, and 
portable scripting language. Python's clear syntax and 
portability are easily integrated to Linux, Windows, 
DOS, OS/2, Mac, Amiga, and many flavors of UNIX. 

Don't delay - Order the Python Resource CD-ROM 
now for the introductory price of $39.95! 

www.ddj.com/cdrom/ 


PRICE: $39.95! 

CALL NOW! 800-992-0549 

E-mail: orders@mfi.com 
Fax:785-841-2624 

Mail: Dr.Dobb sCD-ROMLibrnry 

1601 West 23rd, Ste. 200, Lawrence, KS 66046-2703 
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DEVELOPMENT TOOLS 


Is this your World? ff 


• Writing code 

• Compiling code 

• Checking code 

• Re-writing code 

Are these important to you? 

• Shorter development time 

• Confidence in results 

• State-of-the-art algorithms 

Then try NAG 

• Statistical Components 

• Numerical Components 

• 3D Visualization Components 

• 30 years of software innovation 

• Multi OS Implementations 

When results matter, trust NAG 

NUMERICAL ALGORITHMS GROUP 
630-971-2337 info-ddj@nag.com 

www.nag.com ^ 



C, C++, and JAVA DOCUMENTATION (v. 8.0) 


• C-CALL ($69) Graphic-tree of 
caller/called function hierarchy, cross- 
relercncc. file/funclion index. 

• C-CMT ($69) 
Creates/inserts/updates comment- 
blocks (functions/identifiers used) for 
each function 

• C-METRIC ($59) Calculates path 
complexity, counts lines with 
comments, code. C statements 

• C-LIST ($69) Lists and acbon- 
diagrams. or reformats source into 
user-selected standard formats. 


• C-REF ($69) Creates cross-reference 
of local/global/define/parametcr 
identifiers, class trees. 

•C-DOC ($199) PACKAGE Ail 5 
programs integrated as 1 overall 
C-DOC program <10.000 lines. 
JavTREE graphic-tree viewer (Slree in 
C-DOC) 

• C-DOC Professional ($299) DOS. 
Wm95/NT. OS/2.1.000.000+ Ines. 

• VERSION 8.0! 

30-Day Money-back guarantee. 


SOFTWARE BLACKSMITHS INC. ® swbsxom 

6064 St Ives Way. Mississauga Voice/Fax (905) 858-4466 
ONT Canada L5N-4M1 http://www.swbs.com 


e "A suite of tools and reference 
collection showing developers 
how to create better ANSI C++ 
mry code using UML. It includes "T* 
libraries of useful programming § 
^ snippets and classes that you "f 1 
can use your own P ro i ects t° ^ ^ 
ansi create more efficent, powerful f ^ 
C++ and reliable applications.” 

www.technosoftweb.com 


TECHNOSOFT 


i TST TREE shipping with 
2 day delivery 

fax: (+39).06.56.66.589 
email: orders@technosoftweb.com 



NEW! 
Version 2.15 


ADVERTISE TODAY 
IN 

DR. DOBBS 
MARKETPLACE! 


Code Co-op* 

The versatile Version Control System for 
collaborative development 

• Synchronization using email, local network, floppy disk 

• Intuitive GUI -- check-in, check-out, synch, visual diff. 

• Fully functional trial version available for download 


SERVER-LESS VERSION CONTROL 

www.relisoft.com 


Reliable Software „ 

Smart Tools for Smart Programmers 


Breakthrough in Programming 


ft™'!™ 

i »m »i*u (pukmAfbirt n«T 

■i* i 


B«— j: 

.Q!—« 

. OOW 
- CK--+ 

. Q 

. Ot- J 

• 01.11+ 

• o+*hj 

• O —r- 

• Ou» 

. Oi*. 

i __ v _ ^ 

f'prag & Drop ■ 

raiH i 

i § 1 1 11 


Program with 
pictures, not code! 

Use with ACT!, Word, 
Excel, Powerpoint, or 


Sanscript ™ - by Northwoods Software 


www.TrulyVisual.com 
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C mp uter 
Bo lis! 


Ind pendent 
reviews of 
technical computer 
b ks 

Written by 
developers 
F R developers 

Check it ut! 

www.ddj.c m 


Books Now The Virtual Bookstore 

To order books in this magazine or any book. 
Please call 24 hrs/365 days: (800) B00KS-N0W 
(266-5766) or (702) 258-3338 ask for ext. 1410 
or visit us on the web at 
http://www.booksnow.com/dr.dobbs. 





























































WINDOWS CE 


COMM 



CE-Plus/LCD 


Touch Screen 


Standard 


Visial Basic or Visual C/C++ 

Small Powerful & Easy To Program. 
Plug the CE-Minus-SC400 (486 SBC) 
into your next custom design or into 
our CE-Plus and LCD-Plus I/O 
expansion otions. The CE-Minus is 
easy to program using our custom 
ported Windows-CE & Tools. 

r Enterprises, Inc. _ - „ 

3 Toll Free 1-888-RLC-TECH WWW. RLL. COItl 


Windows £ 

embedded Computer 


CE-Minus 

Single Board Computer 


DOCUMENTATION TOOLS 


Generate Documentation 
from your source code with DocJet! 

Produce HTML, 

MSHelp, and 
MSWord 

documentation from 
comments in your 
code - and you Mon’t 
need to change your 
commenting style! 

FREE TRIAL VERSION! 
http://mvw.tall-tree.coni 
info@tall-tree.com 512-453-4909 





So many comm choices ... 
So little time ... 

So good to have help . 

T1/E1*FRACTI 
FRAME REF 
X.25* 

CUSTO 
HSSI* 

UN 


II ®T3/E3 
35 •ATM 

aSOLG 

Ia*sna 

NT* OS/2 

|*PCMSA*QNX 
SUN OS«D3S*OC-3*PPP*UNUX 


Let Quadron help you simplify your life and solve your 
communication problems with our solutions. We've been 
helping people like you worldwide for over a decade. 

We offer a large array of communication cards that range 
from simple plug-and-play to custom solutions that 
precisely match your needs. We'll get you what works the 
first time. Check out our web site and call us real soon. 


Quadron • 

vuvuw.quadron.com 

telephone 805-966-6424 • fax 805-966-7630 • email info@quadron.com 

°2000 Quadron Corporation 


SCRIPTING TOOLS 


SECURITY 


Scripting Beyond Limits! 



WinBatch + Compiler 2000 

® Automate 

endless jobs/rollouts 

©Link 

apps, OS, networks, web 

©Build 

fool proof processes 

Free Test Drive 

1-800-762-8383 www.winbatch.corn 


Software Pirates 



Sentry * 

The Dead Lock 
for Software Pirates. 


| www.sentryindia.com| 


The Best Try-Before-Buy Copy 
Protection & Software Licensing 


CrypKey is solid, software-only copy protection with a 
broad range of features to control all aspects of your 
product’s operation. You can offer free one-time trials, turn 
demos into full multi-user network versions, or sell specific 
options by phone, fax or email. Sell usage by time, runs, 
features - the control is all there - easy to implement, and 
even easier to support; and it’s not fooled by reinstallation 
or back-dating. Imagine Internet distribution of your 
software with easy e-commerce features and automated 
authorizations without needing specialized equipment! 


www.crypkey.com 


EDUCATION 

I I 

GRAPHICS LIBRARIES 

< 

PROLOG TOOLS 




Program For Your Future 

Earn your B.S. or MS. in Computer Science 
through distance education. 

• Prepare for one of the thousands of computer science jobs available 

• Increase your earning power 

• Study from home or office at your convenience 

• Approved by more than 330 companies 

• Follows ACM/IEEE guidelines 

• Courses teach leading industry languages: ; 

C++, Java, Visual Basic, and more 

por a * ree cata !°9 ca H ^ 

Je 1 -800-767-2427 or visit cs.aia.edu «. 
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pr VICTOR 

Image Processing Library 

Fast BMP, TIFF, PCX, GIF, TGA, PNG, JPEG. Adjust 
brightness, contrast, sharpen, create filters, resize, rotate. 
+more of single image, multiple images, or any image area; 
color reduction to optimum, specific, or std. palette; print; scan; 
crop, combine, compare, blend images. 

DOS $199, 16-bit DLL $299, 32-bit DLL $499 
Catenary Systems 
314-962-7833/fax: 314-962-8037 
www.catenary.com/victor 
ask for free demo sre avail visa/mc/c.o.d. 


Make Your Web | 
Site SMART .3 

Advise, solve, route and configure 
with the Amzii 8 LogicServer "* tools & C5 
libraries (DLLs) for Web Servers, Java, JSS 
C/C++, VB, Delphi & more. Win NT ” 
95/98 & Solaris. Use ODBC, Sockets, 
Unicode & OOP. Consulting Services. 

FREE Evaluation Version! 3^ 

Amzie inc. Email info@amzi.com gga 

Call +1-513-425-8050 Fax 425-8025 ^ 
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OF INTEREST 



DarkBASIC is a Windows-based develop¬ 
ment environment designed to let you tap 
directly into the DirectX architecture. Dark¬ 
BASIC programs are compiled into opti¬ 
mized scripts that run almost as fast as C. 
DarkBASIC supports numerous graphics 
features, including automated double 
buffering, full-screen display modes, AVI 
animation control, MIDI music control, 
and 3D sound effects. Supported 2D and 
3D feartires include landscape terraform¬ 
ing, dynamic model space, polygon col¬ 
lision detection, model animation, ambi¬ 
ent lighting, alphablending, fogging, and 
more. DarkBASIC is available on CD-ROM 
for $70.00. A trial version of DarkBASIC, 
along with documentation and special-effect 
demos and tools, is available at the com¬ 
pany’s web site. 

Dark Basic Software Ltd. 

4 Nancy View 
Bollington, Cheshire 
SK10 3QG, UK 
http://www.darkbasic.com/ 

The Python development team has joined 
the startup company BeOpen.com, and 
Python-creator Guido Van Rossum has 
been named director of the PythonLabs 
development team. The team includes 
three of Van Rossum’s former colleagues 
at CNRI: Fred Drake, Jeremy Hylton, and 
Barry Warsaw. Tim Peters will also join 
the team shortly. Python 1.6 will be the 
last release from CNRI and all future re¬ 
leases will be from BeOpen.com. Python 
will remain Open Source, and http:// 
www.python.org/, hosted by CNRI, will 
remain die primary web site for die Python 
community. 

BeOpen.com 
160 Saratoga Avenue 
Santa Clara, CA 95051 
http://www.pythonlabs.com/ 

Spider Software has ported its Spider- 
STREAMS—a platfomi for the deployment 
of wide-area communications protocols— 
to Linux. The STREAMS protocol stacks run 
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as a Linux process, interacting with appli¬ 
cations through an interprocess communi¬ 
cation driver. It requires no modifications 
to the Linux kernel code. Frame Relay and 
X.25 will be the first protocols to be de¬ 
ployed by Spider in a Linux environment. 
The initial release will be on PC hardware 
and PCI interface cards. 

Spider Software Inc. 

3131 East Camelback Drive, Suite 200 
Phoenix, AZ 85016 
602-606-5780 
http://www.spider.com/ 

Functional Developer 2.0, a Windows-leased 
development environment for the Dylan 
language, is now available from Function¬ 
al Objects. The release is an upgrade to 
Harlequin Dylan 1.2, adding performance 
profiling, Visual SourceSafe support, macro 
debugging facilities, network-based de¬ 
bugging and interaction, incremental search, 
dynamic completion, call tracing, and reg¬ 
ister browsing. New open-source libraries 
include Deuce, an Emacs-like editor, and 
DOOD, a persistence and serialization 
mechanism. 

Functional Objects Inc. 

86 Chandler Street 
Somerville, MA 02144-1912 
617-625-7289 

http://www.functionalobjects.com/ 

Oakdale Engineering has announced that 
Data Fit 7.0 is now shipping. DataFit is de¬ 
signed to aid in the tasks of curve fitting 
(nonlinear regression), statistical analysis, 
and data presentation. It determines 
whether a relationship exists between two 
or more variables, describes the nature of 
the relationship in the form of a mathe¬ 
matical equation, and then assesses the 
degree of accuracy of prediction achieved 
by the equation. Improvements in Version 
7.0 include a reduction in solution time, 
enhanced 2D and 3D plotting capabilities, 
the addition of plot templates, stepwise 
variable selection procedures (data min¬ 
ing), enhanced data importing and edit¬ 
ing features, and enhancements to non- 
graphical macro features. DataFit runs on 
Windows and costs $199.00 for a single- 
user license. 

Oakdale Engineering 
23 Tomey Road 
Oakdale, PA 15071 
724-693-0320 

http://www.curvefitting.com/ 

Pro Works LLC has released Flipper Graph 
Control 2.0, an upgrade to its ActiveX chart¬ 
ing control. Version 2.0 features include en¬ 
hanced compatibility with the Web, in¬ 
creased flexibility for scientific and financial 
charts, an improved look and feel, and 
greater customizing capability. Other fea¬ 
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tures include ADO Recordset reading, OLE 
drag-and-drop support, tool tips, and im¬ 
proved date formatting and incrementing. 
Graph types include 2D and 3D line, bar, 
points, areas, stacked bars, hi-lo, pie, bub¬ 
ble, spider, and true 3D surfaces. Multiple 
graphs can be added to the control for drill¬ 
down functions or merged to present data 
on more than two y-axes. 

ProWorks LLC 
2371 NW Maser Drive 
Corvallis, OR 97330 
541-752-9885 

http://www.proworks.com/ 

Software AG has launched Tamino, a na¬ 
tive XML information server that provides 
web-enabled data exchange and applica¬ 
tion integration. Tamino can store and treat 
data structures of any kind as XML ob¬ 
jects, increasing interoperability of data 
among applications. XML data without a 
previously defined structure is also ac¬ 
cepted and stored. Tamino can provide 
additional communication channels as nec¬ 
essary by adopting existing HTTP servers, 
and it supports single-sign-on security sys¬ 
tems and existing methods of encryption 
(RACF, NTLM, Kerberos, and SSL). It is 
available now for Windows NT, with ver¬ 
sions for UNIX, Linux, and IBM main¬ 
frames to follow later this year. 

Software AG 

Bishop Ranch 3 

2613 Camino Ramon, Suite 110 

San Ramon, CA 94583 

925-242-3700 

http://www.softwareagusa.com/ 

SL Corporation unveiled a new suite of 
SL-GMS tools for component-based tech¬ 
nologies: The AX/Developer is for appli¬ 
cations that require dynamic graphics in 
an ActiveX environment; the C++/Devel- 
oper supports a range of graphics displays 
and user interfaces using C++; the J/De- 
veloper is designed for quick prototyping 
and deployment of Java applications and 
applets; Custom Editor creates custom ed¬ 
itors for virtually any control system; and 
J/Net, C++/Map, and C++Net are exten¬ 
sions to C++/Developer and J/Developer 
for telecommunications and network man¬ 
agement applications. 

SL Corp. 

Suite 110 Hunt Plaza 
240 Tamal Vista Boulevard 
Corte Madera, CA 94925 
415-927-1724 
http://www.sl.com/ 

ActiveBatch 3.0, a distributed job-man¬ 
agement and scheduling system, has been 
released by Advanced Systems Concepts. 
ActiveBatch supports execution of batch 
jobs and streams across a set of platforms 

http://www. ddj. com 



including NT, UNIX, and OpenVMS. It is 
script-language independent and can be 
used to submit jobs via languages such as 
XLNT, Perl, VBScript, Java, and BAT 
(CMD). Jobs can l)e scheduled ad hoc, on 
a recurring basis, or in response to event 
triggers, and jobs can also be started and 
submitted based on the results and status 
of previously submitted jobs. ActiveBatch 
records and examines all jobs; jobs can 
be monitored for possible failure based 
on Elapsed Time and CPU time; and 
restarting of jobs is allowed. 

Advanced Systems Concepts Inc. 
33-41 Newark Street 
Hoboken, NJ 07030-5604 
201-798-6400 

htt p ://www. advsyscon. com/ 

SOT, a Linux vendor in Finland, has re¬ 
leased its Best Linux 2000 R2-Moscow dis¬ 
tribution for Russian-speaking users. The 
new version is also available in English, 
Swedish, and Finnish, and includes Xfree 
4.0, kernel Version 2.2.14, and Star Office. 
The Best Linux 2000 boxed set also in¬ 
cludes lifetime installation support. 

SOT Finnish Software Engineering Ltd. 
Hermiankatu 8E 
FIN-33720 Tampere, Finland 
358-3-316-5544 
http://www.sot.com/ 

Real Time Integration has announced the 
next generation of its NetAcquire Java 
Toolkit (with integrated JavaBeans sup¬ 
port) for creating Java test and measure¬ 
ment applications and Java virtual instru¬ 
ment front-panels. NetAcquire Java Toolkit 
applications perform real-world data ac¬ 
quisition and control by communicating 
with any member of the NetAcquire fam¬ 
ily of network data acquisition and con¬ 
trol servers. (NetAcquire hardware makes 
analog, digital, and serial data available 
over any Ethernet network.) A complet¬ 
ed application runs on any computer or 
operating system that supports Java 1.1. 
The NetAcquire Java Toolkit offers an 
open architecture environment, interfaces 
to tliird-party JavaBeans class libraries, and 
is compatible with a variety of JavaBeans 
development environments including 
Symantec Visual Cafe. 

Real Time Integration 
733 7th Avenue 
Kirkland, WA 98033 
425-576-0822 

http://www.realtimeint.com/ 

Intuitive Edge has released Datatypes++ 
1.0, a Windows class library that brings 25 
text, numeric, time, and binary datatypes 
to C++, similar to those found in Java, 
SQL, and Visual Basic. The text types can 
be converted to and from all other types 


in dozens of dialects and include Unicode 
support. The numeric types include a dec¬ 
imal type that can represent fixed or dy¬ 
namic high-precision numbers. The time 
types (time, date, and timestamp) can rep¬ 
resent time in 100 world clocks with 
nanosecond precision. The binary datatypes 
include support for binary large objects 
and bitsets. Both Microsoft and Borland 
C++ compilers are supported. 

Intuitive Edge Corp. 

13400 Northup Way, Suite 47 
Bellevue, WA 98005 
425-746-5925 

http://www.intuitiveedge.com/ 

Inner Media has begun shipping DynaZIP- 
GT, a royalty-free Gzip and Tar (Posix) 
compatible data compression toolkit for 
Windows. DynaZIP-GT lets you read/write 
standard Gzip and Tar files under program 
control. These files are fully compatible 
and may be shared with other Gzip and 
Tar programs and utilities on both Win¬ 
dows and UNIX-compatible platforms. In¬ 
cluded is full support for file-to-file, file- 
to-memory, and memory-to-memory 
operations, multithreading, Active Server 
Page web pages, status reporting, and 
background operations. 

Inner Media Inc. 

60 Plain Road 
Hollis, NH 03049 
603-465-3216 

http://www.innermedia.com/ 

TimeSys has announced the availability of 
its TimeSys Linux/RT 1.0, a real-time vari¬ 
ation of the Linux OS for embedded sys¬ 
tems. The TimeSys Linux/RT distribution 
includes subsystems that combine to han¬ 
dle a variety of application requirements 
from small footprint to full-featured archi¬ 
tectures. The most critical subsystem is die 
Resource Kernel, which supports fixed- 
priority scheduling, and priority inheritance, 
high-resolution timers and clocks, and sup¬ 
port for a Temporal Firewall. TimeSys also 
provides installation support, training ser¬ 
vices, and supporting tools. 

TimeSys Corp. 

4516 Henry Street 
Pittsburgh, PA 15213 
412-681-6899 
http://www.timesys.com/ 

Jungo’s GO Hot-Swap enables Hot Swap 
support on Windows, Linux, Solaris, and 
VxWorks. Hot Swap is a facility that en¬ 
ables insertion and removal of Compact 
PCI cards into a Compact PCI-based back 
plane while the system is running. Jungo 
has three deployment methods: the de¬ 
velopment toolkit is designed for Compact 
PCI hardware vendors; the Agent is de¬ 
signed for .system integrators; and the OS 


Extender is designed for system board ven¬ 
dors or operating-system vendors. 

Jungo Ltd. 

P.O.B. 8493 

New Industrial Center Nordau 
42504 Natanya, Israel 
972-9-885-9365 
http://www.jungo.com/ 

Unify has developed Unify eWave Servlet- 
Exec 3.0, a Java Servlet and JavaServer Pages 
engine. It enables server-side Java func¬ 
tionality and integration with backend sys¬ 
tems. The feature set incorporates support 
for the Java Servlet API 2.2 and JSP 1.1 stan¬ 
dards; client certificates; in-process and out- 
of-process configurations for Microsoft IIS, 
Netscape Enterprise Server, iPlanet Web 
Server, Apache Web Server; and support for 
Windows NT, Windows 2000, Solaris, AIX, 
HP-UX, and Linux. 

Unify Corp. 

100 Century Center Court, 3rd Floor 
San Jose, California 95112 
408-451-2000 
http://www.unify.com/ 

New features for the Version 7.0 of Vital’s 
CRiSP visual text editor include multiple 
document support, a more advanced file 
compare facility, both GUI and character 
modes, a built-in ftp client, the capability 
to edit text and binary files above 2 GB, 
template/smart editing, dynamic spell 
checking, intraline differencing/merging, 
a projects facility, and code beautifying 
for HTML, C/C++, and XML. CRiSP sup¬ 
ports a variety of platforms including Win¬ 
dows, Linux, Solaris, and UNIX. 

Vital Inc. 

5136 Village Creek Drive 
Plano, TX 75093 
972-818-2424 
http://www.vital.com/ 

Microware has issued a new version of 
Personal Java for its OS-9 embedded pro¬ 
cessor. Personal Java 3.0.1 has faster ex¬ 
ecution, a smaller footprint, multiple win¬ 
dows support, and a Java Profiler Interface 
allowing tools to interface with Java and 
evaluate the performance of Java appli¬ 
cations remotely. You can download Java 
classes from a central spot to the OS 9 de¬ 
vices and also create plug-ins in C, C++, 
or assembly languages that can be down¬ 
loaded to the device through wired or 
wireless networks. 

Microware Systems Corp. 

1500 NW 118di Street 
Des Moines, LA 50325 
515 - 223-8000 

http://www.microware.com/ 


DDJ 


http:,//www. ddj. com 


Dr Doths Journal, August 2000 


151 





SWAINE'S FLAMES 



No Formal Wear, No Nuns, No Chilly Willy 

W hen the gang over at CNet published the results of their OS Death Match—Mac OS 9 the 
victor over Corel Linux by a nontechnical knockout—Jon Erickson snarled at me to get a 
reaction story. 

“Interview the penguin,” Erickson growled, chomping on a cigar while adjusting his green 
visor. “We’ll run it in ‘Swaine’s Flames.’ Invite him to Foo Bar.” 

“Couldn’t I just meet Bobby Knight in a dark alley and grill him about the allegations that he 
chokes his players and beats up reporters?” 

The boss’s leer was withering. “You’re the only person who’s managed to get an interview with 
that legendarily reclusive bird; I’ll give you that. But you’ve done it once, you’ll do it again.” 

“He’s not so much reclusive as just unfriendly,” I muttered on my way out the door. 

Tux the Linux spokespenguin waddled across the peanut-strewn floor at Foo Bar, the late- 
night hangout where I moonlight as relief bartender, and clambered awkwardly onto a stool, 
knocking over a bowl of pretzels with a fin. 

“Formal wear is not required at Foo Bar, sir,” I said, hoping it couldn’t hurt to lighten the atmosphere. 
“Listen, Mac,” he answered, grabbing my shirtfront with a distressingly sharp claw, “No formal 
wear jokes, no nun jokes, no Chilly Willy jokes, no adolescent humor of any kind, got it? Unless 
you wanna see me walk out of here right now.” 

Actually, I did want to see him walk out of there right then, looking forward to the sight of his 
squat little body waddling doorward across the Foo Bar floor like a bowling pin teetering toward 
the gutter, but I then recalled Erickson’s good humor the last time I returned without a story. “No 
adolescent humor,” I conceded. This was going to be a tough assignment. 

After a couple of Cuba Libres (a favorite drink of another Foo Bar regular), which he accepted 
on my recommendation and Erickson’s tab, Tux got almost human, and I cranked up my courage 
and brought up the CNet piece. 

“That piece of drivel?” he snapped. He rested his beak on the down of his chest and gave me 
his trademark menacing glare. “That was just ‘he-said, she-said’ journalism,” he said. “They only 
liked the Mac OS because they think it’s sexy.” He suddenly sat up straight. “Is that herring?” I set 
the dish in front of him. 

“Well, sexy counts for something in today’s market, doesn’t it? Look at BeOS. Intel apparently 
thinks Be is sexy, given how much it’s invested in the company. And Byte dot corn’s Scot Hacker 
says that BeOS is a better alternative to Windows than Linux for most users. He also says Be is 
the better way to go for building Internet appliances.” 

“Oh, puhleeze. Byte dot com is so over. And Be? That was over a long time ago, even if BeOS 
is the sexiest operating system around, Linux is hotter than sex.” 

“Huh?” 

“Yeah, Gunnar Isaksson ran the words ‘Linux,’ ‘Windows,’ and ‘sex’ through the AltaVista 
search engine and got 11,313,520 hits for Linux, 10,755,265 for Windows and 9,589,620 for sex. 
This is good herring.” 

“Thanks. So Windows is also more popular than sex, then? And who’s Gunnar Isaksson?” 
“That’s not the point. Two British hackers claimed to have built a web server that runs on 
potatoes. Guess what operating system they said they used?” 

“Sure, I realize that Linux is pioneering important new markets, but...” 

“We’re taking over, that’s what we’re doing. We got Alpha Processor turning itself from a chip 
house into a Linux box vendor, we got companies like Lynx changing their names to sound more 
like Linux, we got Oracle, the biggest database company, trying to become a Linux vendor in 
Japan. Everybody wants to be us. We got our own store at Amazon dot com and our own page at 
DDJ dot com. We got Peter Norton sweeping the floors and Andy Herzfeld painting the walls and 
France passing laws making us mandatory.” 

Whether it was the Cuba Libres or the herring, this was going better than I’d expected. “Ever 
consider cashing in on the Linux boom yourself, Tux? Starting your own company?” 

“Kid, would you want to work for me?” 

All of a sudden, Erickson didn’t look so bad after all. “Not in a million years, Tux. No offense 
intended.” 

“None taken. Got any more herring?” 
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